-- Logs begin at Tue 2022-07-19 15:02:25 UTC, end at Tue 2022-07-19 16:03:11 UTC. -- Jul 19 15:30:44.514780 dv-cinder-849022-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 15:30:44.522090 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 15:30:44 2022] *** Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: nodename: dv-cinder-849022-3-iscsi Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: machine: x86_64 Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: clock source: unix Jul 19 15:30:44.524118 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: pcre jit disabled Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: detected number of CPU cores: 4 Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: current working directory: / Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: detected binary path: /usr/bin/uwsgi-core Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: your processes number limit is 47680 Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: your memory page size is 4096 bytes Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: detected max file descriptor number: 2048 Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: lock engine: pthread robust mutexes Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: thunder lock: enabled Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 15:30:44.524556 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 15:30:44.570467 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: Python main interpreter initialized at 0x55b510f679c0 Jul 19 15:30:44.570467 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: python threads support enabled Jul 19 15:30:44.570467 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: your server socket listen backlog is limited to 100 connections Jul 19 15:30:44.570467 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: your mercy for graceful operations on workers is 90 seconds Jul 19 15:30:44.570846 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 15:30:44.570921 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: *** Operational MODE: preforking *** Jul 19 15:30:44.571190 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: *** uWSGI is running in multiple interpreter mode *** Jul 19 15:30:44.571190 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: spawned uWSGI master process (pid: 86822) Jul 19 15:30:44.571404 dv-cinder-849022-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 19 15:30:44.578393 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: spawned uWSGI worker 1 (pid: 86831, cores: 1) Jul 19 15:30:44.578393 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: spawned uWSGI worker 2 (pid: 86832, cores: 1) Jul 19 15:30:44.578393 dv-cinder-849022-3-iscsi devstack@keystone.service[86822]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 15:30:50.089701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:30:50.089701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: from cryptography.utils import int_from_bytes Jul 19 15:30:50.090527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:30:50.090527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: from cryptography.utils import int_from_bytes Jul 19 15:30:50.090692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:30:50.090692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: from cryptography.utils import int_from_bytes Jul 19 15:30:50.091194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:30:50.091194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: from cryptography.utils import int_from_bytes Jul 19 15:30:50.140212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:30:50.140412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:30:50.140592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:30:50.140688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] command line args: [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:30:50.140820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:30:50.140906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:30:50.141045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] command line args: [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:30:50.141122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ================================================================================ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:30:50.141317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] admin_token = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.141393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:30:50.141539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ================================================================================ {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:30:50.141625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config_dir = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.141801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.141878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] admin_token = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config_source = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] config_dir = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] debug = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] config_source = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] debug = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.142997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.143999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_config_append = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_config_append = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_dir = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_dir = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_file = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.144916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.145781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.146465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.146542 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.146703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.146792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.146853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.146999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.147968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.148995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.149222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.149412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] publish_errors = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.149535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.149898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.149986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] publish_errors = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.150898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151136 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] standard_threads = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] standard_threads = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_journal = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.151974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_json = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] use_journal = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_stderr = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] use_json = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_syslog = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] use_stderr = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] use_syslog = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:30:50.152921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.153947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.154935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.155917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.156883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.157873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.158909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.159854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160585 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.160973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.161834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.162998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163800 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.163969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.164935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.165960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.166948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.167945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.168867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.169846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.170852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.171975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.172928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.173979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.174955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.175903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.176851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.177868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.external = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.external = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.178879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.password = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.token = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.password = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] auth.token = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.179873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.180994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.181958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.182957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.183942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.184987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.185960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.186956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.187032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.187196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.187281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.187614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.187692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.187924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188345 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.188991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.189143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.189446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.189525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.189725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.189802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.190992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.191955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.192033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.192191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.192267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.192430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.192509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.193227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.193314 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.193572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.193647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.193750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.193831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.194879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.195991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.196971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.197957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.198936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.199973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.200939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.201909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.202896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.203892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.204843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.205975 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.206974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.207935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.208011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.208171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.208302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.209834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.210999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.211967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.212943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.213927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] role.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.214977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] role.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.215977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.216978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.217959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.218130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.218209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.218397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.218557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.218802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.218880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.219885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.220869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.221995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.222998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.223992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.224936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.225921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.226001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.226161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.226239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.226435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.227790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.228477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.228617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.228764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.228924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.connection = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.229988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.230987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.231929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.232987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.233114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.233227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.233343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:30:50.233460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:30:50.233460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:30:50.264440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.264669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.264756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.264901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.264985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.265194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.274163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.274291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.302637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.302876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.302999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.303149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.445821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.446002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.495358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.495583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.495729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.495970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.561297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.561528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.561668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.561816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.561948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.562911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.587993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.588224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.588369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.588497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.588634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.588758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.588881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.589638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.601009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.601288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.613695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.613930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.614975 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.615098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.615232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.615355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.615479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.615479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:30:50.632653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.632867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:30:50.633132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.633228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.633350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:30:50.633428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:30:50.633663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.633805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.633933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:30:50.634059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.634194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.634320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.634466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.634590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.634720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.634906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.645524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.646352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.646649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.646777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.646933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.647094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.647281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.647568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.655338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.656014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.658644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.658925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.659208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.659346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.659605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.659743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.659875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.660949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.661079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.661216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.661347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.662028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.662158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.662465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.662746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.688822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.689199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.690499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.690786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.690872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.691134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.696337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.696479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.696563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.696764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.696849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.697048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.704132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.704365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.704460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.704652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.709586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.709877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.709963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.710174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.710313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.710466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.710552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.710748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.710830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.711836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.730193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.730500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.730591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.730819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.735167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.735458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.738820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.739114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.739210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.739410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.744958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.745052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.748599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.748682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.752398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.752494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.752697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.752780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.752985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753358 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.753916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.773427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.773668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.773803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.774050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.774132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.774325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.774450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.774620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.782528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.782852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.784247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.784524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.784606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.784838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.787773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.788054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.788136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.788342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.788421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.788626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.788707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.788905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.788985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.789192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.803034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.803197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.803323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.803434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.803586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.803717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.803871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.804873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.824160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.824486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.827491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.827802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.830817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.831146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.832440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.832761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.834646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.834927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.835011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.835219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.835357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.835563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.842773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.843078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.844401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.844698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.847668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.847949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.848032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.848234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.848315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.848522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.848611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.848802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.857833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.858123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.858289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.858430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.858606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.858890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.866457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.866742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:30:50.867304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.867946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.868971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.869855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.870041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.870120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.870313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.870607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:30:50.909267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b510f679c0 pid: 86831 (default app) Jul 19 15:30:50.909443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b510f679c0 pid: 86832 (default app) Jul 19 15:30:50.913295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962c1a-dded-4b88-8384-cda64290e005 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:50.913593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962c1a-dded-4b88-8384-cda64290e005 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:50.913877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962c1a-dded-4b88-8384-cda64290e005 None None] PATH_INFO: `/v3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:50.918131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Tue Jul 19 15:30:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:30:58.561044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:58.561615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:58.561615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:58.565910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:30:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:30:58.571776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:58.572204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:58.572345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:58.641283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: INFO dbcounter [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] Registered counter for database keystone Jul 19 15:30:58.663106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG oslo_db.sqlalchemy.engines [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:30:58.669347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writer thread running {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:30:58.847162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG passlib.handlers.bcrypt [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86831) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 15:30:58.847596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG passlib.handlers.bcrypt [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86831) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 15:30:58.902206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:58.903869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:59.025992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:30:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 15:30:59.244175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:59.313977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: INFO dbcounter [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] Registered counter for database keystone Jul 19 15:30:59.332807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG oslo_db.sqlalchemy.engines [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:30:59.339115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writer thread running {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:30:59.456519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d6f54-ddc1-49b6-bed9-b940c99424ad None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:59.461017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:59.461674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:59.461958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:59.462233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:59.470303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:59.522098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 15:30:59.522384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3f2b2-7ae0-4c3e-b3e0-085265ffc1fa admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:59.532859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Tue Jul 19 15:30:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:30:59.540935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:59.555667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ea58-9369-46f0-ad2e-285421531d4c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:59.560200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:59.561329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:59.561624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:59.561908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] PATH_INFO: `/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:59.563442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] RBAC: Authorizing `identity:get_project(project_id=6a28683ac9174fb4a8e11a5ac75df07c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:59.617760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 15:30:59.618328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e309933-a6b0-4018-a704-49273ae8227d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:59.622773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Tue Jul 19 15:30:59 2022] GET /identity/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:01.620837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8aa71-8400-426f-a025-397a84b5e277 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:01.621372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8aa71-8400-426f-a025-397a84b5e277 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:01.621372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8aa71-8400-426f-a025-397a84b5e277 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:01.625503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:01.630995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:01.631404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:01.631599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:01.650685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:01.652223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:01.660104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 15:31:01.683432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8aa71-8400-426f-a025-397a84b5e277 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:01.695541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8aa71-8400-426f-a025-397a84b5e277 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:01.699692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce3c00-f504-42ee-9d30-9659eba96130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:01.700335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce3c00-f504-42ee-9d30-9659eba96130 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:01.700626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce3c00-f504-42ee-9d30-9659eba96130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:01.700911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce3c00-f504-42ee-9d30-9659eba96130 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:01.709185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce3c00-f504-42ee-9d30-9659eba96130 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:01.711043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce3c00-f504-42ee-9d30-9659eba96130 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:01.719825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Tue Jul 19 15:31:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:31:01.725871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:01.734869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767a41-9c6c-4bcc-b687-c53fb48c3ae5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:01.739672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0534a-fb42-469a-981a-350929da7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:01.741000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0534a-fb42-469a-981a-350929da7af3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:01.741291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0534a-fb42-469a-981a-350929da7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:01.741570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0534a-fb42-469a-981a-350929da7af3 admin admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:01.743010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0534a-fb42-469a-981a-350929da7af3 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:01.745080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0534a-fb42-469a-981a-350929da7af3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:01.746672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Tue Jul 19 15:31:01 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:03.836322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bafb9-42ec-4ee9-a890-bc0449cce8cf None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:03.836830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bafb9-42ec-4ee9-a890-bc0449cce8cf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:03.836911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bafb9-42ec-4ee9-a890-bc0449cce8cf None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:03.838233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:03.843479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:03.843868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:03.844162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:03.860217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec714-87a1-4696-b759-e624a7caf1c2 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:03.860515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec714-87a1-4696-b759-e624a7caf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:03.860804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec714-87a1-4696-b759-e624a7caf1c2 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:03.861346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:03.862135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:03.862577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:03.868043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:03.868338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:03.868626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:03.907586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG passlib.handlers.bcrypt [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86832) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 15:31:03.908003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG passlib.handlers.bcrypt [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86832) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 15:31:03.947057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:03.954209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:03.955862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:03.970040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:03.994144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.057590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:04.073901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2a1f-a46f-4e06-a415-b6b6a564020b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.079771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.109265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.110068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.110385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.110684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.122057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:04.133479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:04.134634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:04.135651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:04.140412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.184573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa595848-2a64-4d21-a26a-f82c5847df16 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.186874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.223100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.223255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.223964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.224336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.224732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.241939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062a2dc-6e4b-4b7d-81cf-3fc54ebac736 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.276013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.276686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.276984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.277269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.278033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:04.278369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.279848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.292199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:04.293385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.294948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.297719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.399320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:04.399521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1ff01-71a2-4934-a806-3d359b6d1b5d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.400975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.403726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.431267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.432144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.432434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.432716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.433959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.435487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.437113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:04.443192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.457620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.499192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2f4ae-8a47-4b70-8dfd-d74bc7032dfc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.534816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.535611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.535897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.536832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.542117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312769d-fe90-43b4-ade6-d87437f911d1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.555322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.556804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.575875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.576676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.576999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.577285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:31:04.577411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:04.578318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:04.579196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:31:04.579196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:31:04.579196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:31:04.579196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:04.579196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:04.580334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.581787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.583668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:04.584555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.589142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:04.643483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.669288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:04.689349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1765f-9694-4703-bc71-c1e247126f83 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.691862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d5931-fbf3-48b0-909f-6d163aa7ab32 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:04.725790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.726058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:04.726476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.726756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:04.726861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.727029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.727114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:04.727313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:04.727759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:04.728068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.728153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.domain.id=default, user.id=dc78df0f6ac445d5b0a04a3f9969c79f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:04.728442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:04.729459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540ccc0-4e78-41bb-bdbc-9bd8940bbc96 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.729858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba89cef-f09a-4ff9-8141-fef05fe637e6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:04.736490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/role_assignments?user.id=dc78df0f6ac445d5b0a04a3f9969c79f&scope.domain.id=default&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:04.748189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:07.030988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e234-07ed-48a7-917f-b5ebe44a7314 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.031514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e234-07ed-48a7-917f-b5ebe44a7314 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.031514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e234-07ed-48a7-917f-b5ebe44a7314 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.032845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:07.038317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.038769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.038939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.061352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:07.062610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:07.147947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acce52-9cd4-4ebb-9dae-2b0a6a82bd40 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.148274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acce52-9cd4-4ebb-9dae-2b0a6a82bd40 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.148546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acce52-9cd4-4ebb-9dae-2b0a6a82bd40 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.150185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 13/23] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:07.155240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.155534 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.155818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.163723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 11/24] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:07.180094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:07.181309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:07.198654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:07.289596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:07.349777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8248b04-86b8-4471-ae96-e5dfdc891105 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:07.360792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 14/25] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:07.393448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:07.394257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.394570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.394946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.396469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:07.414384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:07.414384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:31:07.445068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:07.445924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:07.446733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:31:07.446733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:31:07.446733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:31:07.446733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:07.446733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 12/26] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:07.451991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:07.557247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:07.565577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:07.571386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d907cd-25ff-448b-af7a-fa6587ff8efe None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:07.612629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:07.614169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.614805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.616770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b17a-d0dd-4137-91c6-eb9552411112 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:07.617210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.618124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:07.619943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:07.621515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:07.646250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 13/27] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:07.652341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:07.717863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:07.718714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.719002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.719287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.752701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:07.763178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:07.764027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:07.764775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:07.769761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 15/28] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:07.776506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:07.831444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19e540-f37f-4d25-bf37-e782b3ede1dd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:07.880371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee6bb-fc68-4e7a-9be8-c2245038ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:07.881426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee6bb-fc68-4e7a-9be8-c2245038ecea None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.881723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee6bb-fc68-4e7a-9be8-c2245038ecea None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.882012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee6bb-fc68-4e7a-9be8-c2245038ecea None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.883014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee6bb-fc68-4e7a-9be8-c2245038ecea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:07.884716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee6bb-fc68-4e7a-9be8-c2245038ecea None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:07.930719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517376-9024-4451-ad16-6dd38792e544 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:07.989930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:07.991014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:07.991463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:07.991896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:07.992795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:07.993260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:07.994890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd202-510c-4dac-a673-3f5ee127034c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:07.996412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.005994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 16/29] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:08.007576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f36f3-3a2f-4423-93c2-108005fc6e66 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.008014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f36f3-3a2f-4423-93c2-108005fc6e66 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.008441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f36f3-3a2f-4423-93c2-108005fc6e66 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.009913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 17/30] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:08.011320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc094b0-4a18-429b-bf8f-afe0ef1c8bbb None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.011846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc094b0-4a18-429b-bf8f-afe0ef1c8bbb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.012323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc094b0-4a18-429b-bf8f-afe0ef1c8bbb None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.014002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 18/31] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:08.018940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc094b0-4a18-429b-bf8f-afe0ef1c8bbb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:08.068470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 14/32] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:31:07 2022] POST /identity/v3/projects => generated 301 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:08.069909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07e18-e464-4d9a-bacc-b04c03b1e8ee None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.070222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07e18-e464-4d9a-bacc-b04c03b1e8ee None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.070539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07e18-e464-4d9a-bacc-b04c03b1e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.089556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-52c07e18-e464-4d9a-bacc-b04c03b1e8ee None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:08.091177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-52c07e18-e464-4d9a-bacc-b04c03b1e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:08.094494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.147471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc094b0-4a18-429b-bf8f-afe0ef1c8bbb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:08.173999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 15/33] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:08.175437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.175741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.176028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.192931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:08.193925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.194208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.194518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.194756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:08.195775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:08.196107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:08.197437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:08.200686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 19/34] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:08 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:08.206610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:08.278060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 16/35] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:08.278771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:08.295426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.346719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368e075-285c-4b40-a382-a86c3c2a744f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:08.401760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:08.402602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.402888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.403165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.405981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:08.407494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:08.408066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.409953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 20/36] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:08.415209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:08.445617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf8fe-f5fe-4933-8fd0-ce1f8ed284c8 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:08.484147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167025-4385-4885-860c-d187fd230291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:08.484840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167025-4385-4885-860c-d187fd230291 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.485132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167025-4385-4885-860c-d187fd230291 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.485420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167025-4385-4885-860c-d187fd230291 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.486180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167025-4385-4885-860c-d187fd230291 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:08.487753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167025-4385-4885-860c-d187fd230291 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:08.511913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 17/37] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 19 15:31:08 2022] POST /identity/v3/roles => generated 219 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:08.512663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167025-4385-4885-860c-d187fd230291 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:08.532201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64190-1166-4a7f-bfc4-1d1ceeae5d4c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:08.569403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.583705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49494b-4c82-4eb2-ba74-3959cb53f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:08.584598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49494b-4c82-4eb2-ba74-3959cb53f92f None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.584915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49494b-4c82-4eb2-ba74-3959cb53f92f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.585268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49494b-4c82-4eb2-ba74-3959cb53f92f None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.586048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49494b-4c82-4eb2-ba74-3959cb53f92f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:08.587661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49494b-4c82-4eb2-ba74-3959cb53f92f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:08.637198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167025-4385-4885-860c-d187fd230291 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:08.672958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.687026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bcb9-9172-4480-b189-32046ebfb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:08.690397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bcb9-9172-4480-b189-32046ebfb397 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.690397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bcb9-9172-4480-b189-32046ebfb397 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.690397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bcb9-9172-4480-b189-32046ebfb397 None admin] PATH_INFO: `/v3/domains/default/users/dc78df0f6ac445d5b0a04a3f9969c79f/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.699653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41bcb9-9172-4480-b189-32046ebfb397 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dc78df0f6ac445d5b0a04a3f9969c79f, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:08.701319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41bcb9-9172-4480-b189-32046ebfb397 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:08.746460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 18/38] 10.222.0.64 () {58 vars in 1361 bytes} [Tue Jul 19 15:31:08 2022] PUT /identity/v3/domains/default/users/dc78df0f6ac445d5b0a04a3f9969c79f/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:08.779863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 21/39] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 19 15:31:08 2022] POST /identity/v3/roles => generated 225 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:08.859505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab1b-36a9-49d8-9d5f-b8cfad32273d None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.860173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab1b-36a9-49d8-9d5f-b8cfad32273d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.860713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab1b-36a9-49d8-9d5f-b8cfad32273d None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.862725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 19/40] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:08.864338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0e12-17c1-4d3f-bba2-3602fce4ffe0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.865139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0e12-17c1-4d3f-bba2-3602fce4ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.865880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0e12-17c1-4d3f-bba2-3602fce4ffe0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.868788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 22/41] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:08.869046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.869550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.870002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.875241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:08.875841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:08.876339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:08.894043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:08.896387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:08.906516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:08.908277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:08.985469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 20/42] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:09.011609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:09.101685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 23/43] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:09.123572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b40f9-e43d-457f-ad62-ff459fc4b156 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:09.124527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:09.146507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:09.164043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:09.164856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:09.165151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:09.165437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:09.166674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:09.168155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:09.169976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 21/44] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:09.175815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:09.235212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efc91-90e3-487b-91cb-4403cc2706f2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:09.266529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:09.283915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7149-7ab4-4935-b5ad-e2b69fad6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:09.284623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7149-7ab4-4935-b5ad-e2b69fad6863 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:09.284919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7149-7ab4-4935-b5ad-e2b69fad6863 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:09.285208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7149-7ab4-4935-b5ad-e2b69fad6863 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:09.286153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7149-7ab4-4935-b5ad-e2b69fad6863 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:09.288380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7149-7ab4-4935-b5ad-e2b69fad6863 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:09.305370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 24/45] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 19 15:31:09 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:31:09.403398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802695e-ac68-4a87-adab-5fbf5295a26d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:09.440182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd07f6-58d0-4727-8d2b-c4169bf50ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:09.440867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd07f6-58d0-4727-8d2b-c4169bf50ce8 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:09.441159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd07f6-58d0-4727-8d2b-c4169bf50ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:09.441446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd07f6-58d0-4727-8d2b-c4169bf50ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:09.442220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd07f6-58d0-4727-8d2b-c4169bf50ce8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:09.443766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd07f6-58d0-4727-8d2b-c4169bf50ce8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:09.471725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 22/46] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:31:09 2022] POST /identity/v3/projects => generated 312 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:31:10.866743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77545f-59f8-44c6-a67e-e579139a787a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:10.867277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77545f-59f8-44c6-a67e-e579139a787a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:10.867277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77545f-59f8-44c6-a67e-e579139a787a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:10.868689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 25/47] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:10.874003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:10.874415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:10.874687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:10.896863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:10.898092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:10.940183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:10.974100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 23/48] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:10.997031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77545f-59f8-44c6-a67e-e579139a787a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.097844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77545f-59f8-44c6-a67e-e579139a787a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.132400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.133192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.133480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.133760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.143910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:11.151773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:11.152785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:11.153713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 26/49] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:11.160427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.259785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7909b9-6cd5-47bf-a1af-12856d84624e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.294859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.295535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.295826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.296110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.296870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:11.297185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:11.298618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:11.310270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 24/50] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:11.315826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.360278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:11.418038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede0f47-6e5d-4e6d-bc36-f3454982bcc7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.451536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e941605-607c-450c-83ed-5b54cab4216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.452422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e941605-607c-450c-83ed-5b54cab4216f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.452716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e941605-607c-450c-83ed-5b54cab4216f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.453002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e941605-607c-450c-83ed-5b54cab4216f None admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.454214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e941605-607c-450c-83ed-5b54cab4216f None admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:11.455732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e941605-607c-450c-83ed-5b54cab4216f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:11.457394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 27/51] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:11 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:11.463309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.494598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:11.509166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6aa63-5b38-4f08-a5ed-7f73578ffd93 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.509467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6aa63-5b38-4f08-a5ed-7f73578ffd93 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.509759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6aa63-5b38-4f08-a5ed-7f73578ffd93 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.511292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 28/52] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:11.516053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.516413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.516703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.533704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:11.534927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:11.564578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b315-048c-44ef-bcfb-aee1a1cbbfb0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.599656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.600466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.600737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.601018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.601783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 29/53] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:11.602193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:11.603678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:11.605297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 25/54] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:11.610875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.624194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.651878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:11.714962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d4136-4363-4d7f-b0fb-1f453acbdbe4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.729136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:11.732371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5557f-b267-45a2-a29f-fe08308e465f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.749520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.750184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.750515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.750817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.751652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.domain.id=default, user.id=dc78df0f6ac445d5b0a04a3f9969c79f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:11.751976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:11.753430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:11.760160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 30/55] 10.222.0.64 () {56 vars in 1322 bytes} [Tue Jul 19 15:31:11 2022] GET /identity/v3/role_assignments?user.id=dc78df0f6ac445d5b0a04a3f9969c79f&scope.domain.id=default&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:11.767476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491af78-3a5d-46fb-940e-ef5210988050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.768265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491af78-3a5d-46fb-940e-ef5210988050 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.768560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491af78-3a5d-46fb-940e-ef5210988050 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.768850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491af78-3a5d-46fb-940e-ef5210988050 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.770325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491af78-3a5d-46fb-940e-ef5210988050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:11.771706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491af78-3a5d-46fb-940e-ef5210988050 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:11.773688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 26/56] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:11.779659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:11.884841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba4fe5-4db7-41b3-bd28-377dcdca5613 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:11.887286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:11.922391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50161e-9a50-4e34-a198-09099fe656ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:11.923057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50161e-9a50-4e34-a198-09099fe656ab None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:11.923347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50161e-9a50-4e34-a198-09099fe656ab None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:11.923633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50161e-9a50-4e34-a198-09099fe656ab None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:11.924344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50161e-9a50-4e34-a198-09099fe656ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:11.925854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50161e-9a50-4e34-a198-09099fe656ab None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:11.954454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 31/57] 10.222.0.64 () {60 vars in 1140 bytes} [Tue Jul 19 15:31:11 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:14.017479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c7c69-4493-4055-88ef-da109ae50887 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:14.017965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c7c69-4493-4055-88ef-da109ae50887 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:14.017965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c7c69-4493-4055-88ef-da109ae50887 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:14.019393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 27/58] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:14.025033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:14.025425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:14.025607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:14.042393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:14.043599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:14.109090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 32/59] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:14.133666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c7c69-4493-4055-88ef-da109ae50887 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:14.233607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c7c69-4493-4055-88ef-da109ae50887 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:14.268926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb548b-5afd-4541-8fe4-deb1a3c40598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:14.269657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb548b-5afd-4541-8fe4-deb1a3c40598 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:14.269949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb548b-5afd-4541-8fe4-deb1a3c40598 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:14.270237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb548b-5afd-4541-8fe4-deb1a3c40598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:14.271552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb548b-5afd-4541-8fe4-deb1a3c40598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:14.273008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb548b-5afd-4541-8fe4-deb1a3c40598 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:14.274930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 28/60] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:14.280391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:14.362574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:14.378267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0380-d389-4bf1-b497-e184f961f5b0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:14.412273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d0877-1267-409d-9d59-b3042d26fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:14.412941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0877-1267-409d-9d59-b3042d26fa2d None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:14.413235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0877-1267-409d-9d59-b3042d26fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:14.413524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0877-1267-409d-9d59-b3042d26fa2d None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:14.414251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d0877-1267-409d-9d59-b3042d26fa2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:14.415748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d0877-1267-409d-9d59-b3042d26fa2d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:14.441481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 33/61] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:14 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:17.773529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08691aa9-d3ae-4352-bb5f-797b6f782d37 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:17.774461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08691aa9-d3ae-4352-bb5f-797b6f782d37 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:17.775151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08691aa9-d3ae-4352-bb5f-797b6f782d37 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:17.776932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 29/62] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:17.783987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94b277-39a8-41b3-8e97-7f6ecd3ca858 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:17.784761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94b277-39a8-41b3-8e97-7f6ecd3ca858 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:17.785234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94b277-39a8-41b3-8e97-7f6ecd3ca858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:17.807931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0c94b277-39a8-41b3-8e97-7f6ecd3ca858 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:17.809416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c94b277-39a8-41b3-8e97-7f6ecd3ca858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:17.853142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f1c7-0e61-493f-bcce-74f2223f0576 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:17.853719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f1c7-0e61-493f-bcce-74f2223f0576 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:17.854332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f1c7-0e61-493f-bcce-74f2223f0576 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:17.856530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 30/63] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:17.862487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:17.862783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:17.863070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:17.895539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:17.896852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:17.919991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 34/64] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:17.921338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de77529-d2b6-45ba-9cb0-6c4cdc25fc82 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:17.921794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de77529-d2b6-45ba-9cb0-6c4cdc25fc82 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:17.922242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de77529-d2b6-45ba-9cb0-6c4cdc25fc82 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:17.924484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 35/65] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:17.932629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:17.933187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:17.933774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:17.949089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:17.960744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:17.962261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:17.994725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 31/66] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:17.995801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.054306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 36/67] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:18.055305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.059621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.116632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa3107-840e-45e6-8475-6b339de43f0f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.154159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8a649-bc3b-45a4-b539-2975200b8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.155010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8a649-bc3b-45a4-b539-2975200b8603 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.155308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8a649-bc3b-45a4-b539-2975200b8603 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.155578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8a649-bc3b-45a4-b539-2975200b8603 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.167470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe4286-e00f-4183-8dc0-ca9910e042c8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.168553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8a649-bc3b-45a4-b539-2975200b8603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-9de8a649-bc3b-45a4-b539-2975200b8603 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:18.178247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:18.179232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:18.179972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 32/68] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:18.180790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cf2f8-ad95-408c-8c62-7438773c9d97 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.181082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cf2f8-ad95-408c-8c62-7438773c9d97 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.181369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cf2f8-ad95-408c-8c62-7438773c9d97 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.182668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 33/69] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:18.183420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cf2f8-ad95-408c-8c62-7438773c9d97 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.207227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e71d6-e7d1-4a37-9151-0279e99fabd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.208739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e71d6-e7d1-4a37-9151-0279e99fabd9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.209025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e71d6-e7d1-4a37-9151-0279e99fabd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.209302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e71d6-e7d1-4a37-9151-0279e99fabd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.211388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.220023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e71d6-e7d1-4a37-9151-0279e99fabd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6b4e71d6-e7d1-4a37-9151-0279e99fabd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:18.228978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:18.229837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:18.230825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 37/70] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:18.231658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed229cf-e1db-4c3c-8c79-c95f38a6a595 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.231744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed229cf-e1db-4c3c-8c79-c95f38a6a595 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.231982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed229cf-e1db-4c3c-8c79-c95f38a6a595 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.233248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 38/71] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:18.233939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed229cf-e1db-4c3c-8c79-c95f38a6a595 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.295013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cf2f8-ad95-408c-8c62-7438773c9d97 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.298260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.329204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fe65-f025-4d4a-b2b2-93ce954d1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.330000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fe65-f025-4d4a-b2b2-93ce954d1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.330295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fe65-f025-4d4a-b2b2-93ce954d1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.330613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fe65-f025-4d4a-b2b2-93ce954d1cc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.339143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed229cf-e1db-4c3c-8c79-c95f38a6a595 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.340564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407fe65-f025-4d4a-b2b2-93ce954d1cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-9407fe65-f025-4d4a-b2b2-93ce954d1cc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:18.348287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:18.349183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:18.350176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 34/72] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:18.351101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c41b-1ec2-4fec-ba2e-7f0984af80e0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.351101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c41b-1ec2-4fec-ba2e-7f0984af80e0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.351344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c41b-1ec2-4fec-ba2e-7f0984af80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.368687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-32d9c41b-1ec2-4fec-ba2e-7f0984af80e0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:18.369898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-32d9c41b-1ec2-4fec-ba2e-7f0984af80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:18.376731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.377398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.377685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.377965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.378761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:18.379073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.381162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.389239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 39/73] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.390022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.436851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 35/74] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:18.438134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.438528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.438927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.456220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:18.457445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:18.469368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.491956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccfd10-0630-4706-ba5d-98f905594811 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.516060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.527134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 36/75] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:18.527984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.532059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.532924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.533355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.533783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.534806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:18.535260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.537495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.548166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 40/76] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.549543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.624412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d256c30-64f8-453f-a7a0-d04e14c42249 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.652765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7c6c-386f-447f-aa59-4b093f2c46a0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.658127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.658823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.659112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.659401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.660148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:18.660459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.661997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.670010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 37/77] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.670937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.685991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.686960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.687770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.688116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.688409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.702645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.704108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.705781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 41/78] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.706582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.752211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.774594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f13a88-6aeb-47b4-a0df-2c281a740b3c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.809096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5240705-2f77-4038-a54a-8852f83aa510 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.809828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.810674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.810962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.811250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.821852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:18.829858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:18.830726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:18.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 38/79] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:18.832586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.849436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.850242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.850570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.850854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.852062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.853520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.855183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 42/80] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.855948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.900368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.934456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bc096-f200-47b2-a4c6-16a35ed832ee None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.957015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac37d33-fc8c-4f2c-a5c3-9ffc23624b44 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:18.968649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.969523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.969812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.970098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.970713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:18.971533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.972861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.974681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 39/81] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.974681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:18.992584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:18.993571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:18.993861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:18.994142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:18.995392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:18.996847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:18.998492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 43/82] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:18.999246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.081727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b9b04-fc0f-4b0a-9083-7a9313e11683 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.096550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8c93-ca94-48b0-b858-40468fce67fa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.115324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.115973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.116263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.116960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.120441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.130560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.131229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.131517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.131803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.132558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:19.132869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.134267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.142080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 44/83] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:19.142875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.186378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.190789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.192881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.243133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82b4a-1712-415d-909a-8b4b629bb7bb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.277794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.278558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.279105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.279634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.281045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.282557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.291551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 40/84] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:19.292408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.310405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 45/85] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:19 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:19.310405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.342324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.423412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea81a5-3cb7-4017-aafc-e0fde17f6ffb None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.427450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.432210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce898468-d0a9-46ca-9f04-0e7a2561df13 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.465197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.465852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.466149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.466468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.469935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.470627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.470919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.471205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.548157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.549591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.555568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.557063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.600402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.678191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.685444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 46/86] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:19.686064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.692527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 41/87] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:19.693489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.806178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf1a8-c44c-45d1-b37c-fac999f32748 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.825721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aa53-8437-45b5-bb1f-b953c1807775 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.848032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.849850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.850301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.850776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.853167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.855566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.858636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 47/88] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:19 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:19.859271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.864733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:19.865612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:19.865901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:19.866187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:19.867508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:19.868966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:19.874507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 42/89] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:19 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:19.875316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:19.881583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.953847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.994739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e82801-ab54-4d10-9839-b07680a5902f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:19.995281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96fc94-2d4f-4f0d-8cf2-f04c909658c9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.031507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.032584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.032958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.033454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.033663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.033759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.034020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] PATH_INFO: `/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.034478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.035261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] RBAC: Authorizing `identity:get_project(project_id=ab9d3d96f9fd4206976edd5b0510fb99)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.037105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.037311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.039016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.039139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 43/90] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:19 2022] GET /identity/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:20.039858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:20.046243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 48/91] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:19 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:20.047311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:20.122602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:20.153402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc6c7-82e3-449d-a640-24f842df3865 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.158963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3360-6a4a-481d-9ce5-71892d0f87b9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.190464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.191589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.192741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.193367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.194440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=73aed356c605492792678ec83716339a) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:20.194922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.196555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.196674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.197419 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.197812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.198197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.199338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:20.204561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 49/92] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:20 2022] GET /identity/v3/role_assignments?user.id=73aed356c605492792678ec83716339a&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=7847dd8004504fe890aac6ff853967c8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:20.207964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:20.281393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.283114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.328958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da4fe8-6b32-433d-b74e-b267f9cf8739 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.366181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:20.369720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.370711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.371186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.371646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.372759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=ab9d3d96f9fd4206976edd5b0510fb99, user.id=73aed356c605492792678ec83716339a) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:20.373292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.375036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.382410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 50/93] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:20 2022] GET /identity/v3/role_assignments?user.id=73aed356c605492792678ec83716339a&scope.project.id=ab9d3d96f9fd4206976edd5b0510fb99&role.id=7847dd8004504fe890aac6ff853967c8 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:20.383585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:20.415309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 44/94] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:20.420884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:20.459737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:20.529701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96eae1-d9bf-4190-829e-dd5ca4b9942c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.594654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.596766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.597529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.598592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.600680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=dc78df0f6ac445d5b0a04a3f9969c79f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:20.601504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.604672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.619617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 51/95] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:20 2022] GET /identity/v3/role_assignments?user.id=dc78df0f6ac445d5b0a04a3f9969c79f&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:20.640942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d5e8-9116-4549-ab42-27c43771f934 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.723896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbfdd2-3859-4d2f-965b-df8e38f4ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:20.724793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbfdd2-3859-4d2f-965b-df8e38f4ac99 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:20.725087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbfdd2-3859-4d2f-965b-df8e38f4ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:20.725377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbfdd2-3859-4d2f-965b-df8e38f4ac99 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:20.726845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbfdd2-3859-4d2f-965b-df8e38f4ac99 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:20.728344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbfdd2-3859-4d2f-965b-df8e38f4ac99 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:20.730141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 45/96] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:20 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:20.739932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:20.940012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be4eb9-910c-43c3-90d7-5f2cb5140ec2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:20.989889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:21.006241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:21.007920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:21.008419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:21.008908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:21.010493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] RBAC: Adding query filter params (role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=73aed356c605492792678ec83716339a) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:21.011051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:21.013691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab87c0-cbfb-4123-a562-09f5c7115769 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:21.025076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 52/97] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:20 2022] GET /identity/v3/role_assignments?user.id=73aed356c605492792678ec83716339a&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:22.119453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120a06a-c8ce-46e3-8c71-605f2fa8b0d9 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:22.119970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120a06a-c8ce-46e3-8c71-605f2fa8b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:22.120041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120a06a-c8ce-46e3-8c71-605f2fa8b0d9 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:22.121729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 46/98] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:22.135981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:22.136898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:22.137384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:22.163669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:22.165181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:22.243126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 53/99] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:22.287097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120a06a-c8ce-46e3-8c71-605f2fa8b0d9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:22.356377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:22.422270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120a06a-c8ce-46e3-8c71-605f2fa8b0d9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:22.458418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e5a3-7da4-41dc-a220-4122eda54714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:22.459228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e5a3-7da4-41dc-a220-4122eda54714 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:22.459525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e5a3-7da4-41dc-a220-4122eda54714 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:22.459815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e5a3-7da4-41dc-a220-4122eda54714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:22.461009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e5a3-7da4-41dc-a220-4122eda54714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:22.462526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e5a3-7da4-41dc-a220-4122eda54714 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:22.464385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 47/100] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:22.470088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:22.610804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04c03-b72c-4fc4-bfda-977e1c488c61 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:22.637958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:22.658220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d372d3-7ab1-47f9-8df3-666bef8afff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:22.658938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d372d3-7ab1-47f9-8df3-666bef8afff5 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:22.659233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d372d3-7ab1-47f9-8df3-666bef8afff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:22.659522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d372d3-7ab1-47f9-8df3-666bef8afff5 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:22.660247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d372d3-7ab1-47f9-8df3-666bef8afff5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:22.661856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d372d3-7ab1-47f9-8df3-666bef8afff5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:22.712099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 54/101] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:31:22 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:22.747466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5100-c563-4700-a3f9-7bd981eaa996 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:22.747793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5100-c563-4700-a3f9-7bd981eaa996 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:22.748052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5100-c563-4700-a3f9-7bd981eaa996 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:22.749454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 48/102] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:22.755133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:22.755444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:22.755733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:22.783613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:22.784916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:22.889020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 55/103] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:22.938160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5100-c563-4700-a3f9-7bd981eaa996 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:23.087048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5100-c563-4700-a3f9-7bd981eaa996 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:23.097730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:23.130450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:23.132063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.132587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.133072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.144045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:23.152652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:23.153551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:23.154370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:23.156759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 49/104] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:23.163396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:23.298453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9f772-7fd8-4e95-82d3-32cc895092b0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:23.310737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:23.344518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:23.345205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.345501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.345788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.346590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:23.346913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:23.348896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910119f6-f047-474e-a7b1-f0a9472a3edf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:23.361871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 56/105] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:23.369347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:23.508775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c98df1-9bb9-47fe-845a-b8e257e9bfa6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:23.530175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621feee-54e7-4c4b-b1f0-ac87c9ef79d8 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.530528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621feee-54e7-4c4b-b1f0-ac87c9ef79d8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.530791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621feee-54e7-4c4b-b1f0-ac87c9ef79d8 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.533038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 57/106] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:23.539043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f41f8d-a86f-441f-ad9a-cce57fb32308 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.539369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f41f8d-a86f-441f-ad9a-cce57fb32308 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.540112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f41f8d-a86f-441f-ad9a-cce57fb32308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.555257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:23.556442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.556925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.557420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] PATH_INFO: `/v3/users/a499e83481e340be86d07aae79159c92` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.567519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-95f41f8d-a86f-441f-ad9a-cce57fb32308 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:23.568760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-95f41f8d-a86f-441f-ad9a-cce57fb32308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:23.597347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] RBAC: Authorizing `identity:get_user(user_id=a499e83481e340be86d07aae79159c92)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:23.598950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:23.601017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 50/107] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:23 2022] GET /identity/v3/users/a499e83481e340be86d07aae79159c92 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:23.606542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:23.673949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:23.702122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 58/108] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:23.707838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c203-5c2f-4d13-8350-0031015aadcd None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.708135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c203-5c2f-4d13-8350-0031015aadcd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.708421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c203-5c2f-4d13-8350-0031015aadcd None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.709871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 59/109] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:23.714605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.714898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.715180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.744698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:23.745898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:23.782420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d707-0117-4549-926e-b2a1e4dd4640 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:23.820334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:23.820920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:23.821216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:23.821504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:23.889152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 60/110] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:23.894192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:23.939646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:23.953788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:23.956934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:24.012742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.055198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70cca-e65e-4688-87dd-bd59e211b723 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.095487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a73ef-2942-42ab-95b5-4beb4fbc3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.096426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a73ef-2942-42ab-95b5-4beb4fbc3930 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.096786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a73ef-2942-42ab-95b5-4beb4fbc3930 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.097135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a73ef-2942-42ab-95b5-4beb4fbc3930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.108393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a73ef-2942-42ab-95b5-4beb4fbc3930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:24.115001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 51/111] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:24.115913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-046a73ef-2942-42ab-95b5-4beb4fbc3930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:24.121563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:24.122437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:24.123211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 61/112] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:24.124199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5016-d1ad-4667-8e26-a413d0e08e40 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.130383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5016-d1ad-4667-8e26-a413d0e08e40 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.130383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5016-d1ad-4667-8e26-a413d0e08e40 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.132071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 62/113] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:24.132864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee5016-d1ad-4667-8e26-a413d0e08e40 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.236998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366754d6-f070-4bcf-87eb-02ac3578f8c0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.241644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.260140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee5016-d1ad-4667-8e26-a413d0e08e40 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.276247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.289730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7644-bd07-4ce0-8f92-d5b2f7f0deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.291298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7644-bd07-4ce0-8f92-d5b2f7f0deaa None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.291850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7644-bd07-4ce0-8f92-d5b2f7f0deaa None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.292301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7644-bd07-4ce0-8f92-d5b2f7f0deaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.298638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.299859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.300223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.300577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.302005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:24.303707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:24.305477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd7644-bd07-4ce0-8f92-d5b2f7f0deaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:24.310594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 63/114] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:24.311434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-bdbd7644-bd07-4ce0-8f92-d5b2f7f0deaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:24.314441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:24.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:24.316442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:24.319871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 52/115] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:24.322919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.323433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.323925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.347026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:24.349310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:24.422723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 53/116] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:24.423584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.429706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f41d7-8dc8-40b7-a355-8b24345983dc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.474669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.475364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.475676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.475941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.476709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:24.477032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:24.478470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:24.487287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 64/117] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:24.488137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.510305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.546407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c430-4295-4456-b65f-c260cd954f6d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.564133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.585937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.586646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.586939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.587244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.588089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] RBAC: Adding query filter params (role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=a499e83481e340be86d07aae79159c92) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:24.588414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:24.589924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9de24-81a6-40ed-a9bf-42165d799f88 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:24.598874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 54/118] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/role_assignments?user.id=a499e83481e340be86d07aae79159c92&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:24.600203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f655-801f-40d0-97cc-02e76b5e45a3 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.600501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f655-801f-40d0-97cc-02e76b5e45a3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.600790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f655-801f-40d0-97cc-02e76b5e45a3 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.602088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 55/119] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:24.606605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58f655-801f-40d0-97cc-02e76b5e45a3 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.625526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5b93-eedc-4c74-89b4-020feaf8f123 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.689402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.691127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.692443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.692959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.694260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:24.695366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:24.697319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:24.709905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 65/120] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:24.711777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.744685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58f655-801f-40d0-97cc-02e76b5e45a3 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.802696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44283536-2218-440f-a3ec-0572bfcfca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.804034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283536-2218-440f-a3ec-0572bfcfca8a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.804503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283536-2218-440f-a3ec-0572bfcfca8a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.805800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283536-2218-440f-a3ec-0572bfcfca8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.813563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.820766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44283536-2218-440f-a3ec-0572bfcfca8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-44283536-2218-440f-a3ec-0572bfcfca8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:24.831617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:24.832647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:24.833890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:24.835870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 56/121] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:24.837354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.837651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.837940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.846609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b4e0-cf74-4911-85c3-2dc02b604c14 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:24.855966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:24.857119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:24.885444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:24.887282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:24.887792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:24.888424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:24.890469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:24.892169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:24.893794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:24.894702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 66/122] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:24.897204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:24.933065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 57/123] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:24.938529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.044987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b06873-3c1a-4ec4-8ffd-785ba9148507 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.057963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9d1cc-dcce-4754-b325-31e012ef4126 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.094096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.095013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.095308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.095595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.097245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.098782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.100453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 67/124] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.100890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.101867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.102378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.102855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.103846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:25.104164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.105898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.106984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.116856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 58/125] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.118337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.124488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.162870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.220127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab91a8-b027-4757-82b6-61f56a2bc9ef None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.255848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76488-4383-45df-a0b3-a0f80cd13cd3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.260375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.261357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.261761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.262142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.263501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.265049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.267014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 68/126] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.271422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.299249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.300562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.301961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.302416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.317394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:25.329128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:25.330171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:25.331167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:25.338823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 59/127] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:25.338823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.370898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.396355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53bb3-e68f-48db-b2a7-f4479a00e4ca None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.434915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.435823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.436108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.436389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.437577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.439237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.441371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 69/128] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.442943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.472744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.484395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af608c-5fa0-46ad-a791-223579dcbe8d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.520818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.521690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.521977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.522255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.523493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.525248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.526912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 60/129] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.527670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.561319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d01a2-6dcf-41bf-8f0d-8142bab51117 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.597080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.598567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.598864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.599150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/dc78df0f6ac445d5b0a04a3f9969c79f/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.601145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b71184c3b784a6c8662c36cc6a4f873, user_id=dc78df0f6ac445d5b0a04a3f9969c79f, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.602643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.626488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 70/130] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:25 2022] PUT /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/dc78df0f6ac445d5b0a04a3f9969c79f/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:25.626488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.639713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.649137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca7cc0-f451-498a-9f3d-c49b87b68f76 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.700546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.701348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.701726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.702066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.703015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:25.703414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.705280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfe61f-f9a5-4ad0-9fe2-d23af9e1ff6b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.727283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 61/131] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.727283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686fe57-8366-467d-913c-24dc5cd9a5ca None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.727283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686fe57-8366-467d-913c-24dc5cd9a5ca None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.727283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686fe57-8366-467d-913c-24dc5cd9a5ca None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.727283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 62/132] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:25.727283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686fe57-8366-467d-913c-24dc5cd9a5ca None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.766044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.783547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce21f2e-73cd-4ef2-9373-ff5da01f5ed0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.835757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.836928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.837374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.838256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/73aed356c605492792678ec83716339a/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.841424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] RBAC: Authorizing `identity:create_grant(project_id=9b71184c3b784a6c8662c36cc6a4f873, user_id=73aed356c605492792678ec83716339a, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.843120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.859569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 71/133] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:25 2022] PUT /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/73aed356c605492792678ec83716339a/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:25.860845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:25.875976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686fe57-8366-467d-913c-24dc5cd9a5ca None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:25.916286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ff4a-e70f-41b8-96a4-56121e9a76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:25.917206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ff4a-e70f-41b8-96a4-56121e9a76c1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.917595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ff4a-e70f-41b8-96a4-56121e9a76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.917910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ff4a-e70f-41b8-96a4-56121e9a76c1 None admin] PATH_INFO: `/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.919286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ff4a-e70f-41b8-96a4-56121e9a76c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ab9d3d96f9fd4206976edd5b0510fb99)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:25.920927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ff4a-e70f-41b8-96a4-56121e9a76c1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:25.923227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 63/134] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:25.924477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:25.924826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:25.925114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:25.943783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:25.945103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:25.952644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:25.997401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f9ea-baf3-4d0c-874b-13749839721d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:26.065864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 64/135] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:26.072652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:26.093232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:26.093690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.093987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.094284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:26.101781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:26.106708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 72/136] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:25 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:26.114370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:26.132282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:26.247080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5ac7-afa2-45e8-b31b-72132b9260f0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:26.257998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89d913-4b9e-4383-b7f5-fa2a46b7d1f8 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:26.320669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:26.322255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.322762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.323095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:26.323470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.324004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.324295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.324592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] PATH_INFO: `/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99/users/73aed356c605492792678ec83716339a/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.325437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:26.326703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab9d3d96f9fd4206976edd5b0510fb99, user_id=73aed356c605492792678ec83716339a, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:26.327351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:26.328155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:26.329842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 73/137] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:26 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:26.335319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:26.340716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:26.362336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 65/138] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:26 2022] PUT /identity/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99/users/73aed356c605492792678ec83716339a/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:26.363232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:26.530055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a534599-a3f7-4fa7-87f2-641d473cc36a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:26.568234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:26.605915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:26.607463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.607981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.608458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.608558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df7f67-c3df-4c5a-8cb9-a2f3903fb13e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:26.610542 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:26.612329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:26.616416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 74/139] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:26.623347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:26.677641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e20ff-8047-42ac-8357-6a3ea77656c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:26.680073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e20ff-8047-42ac-8357-6a3ea77656c1 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.680753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e20ff-8047-42ac-8357-6a3ea77656c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.682531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e20ff-8047-42ac-8357-6a3ea77656c1 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/73aed356c605492792678ec83716339a/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.686605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e20ff-8047-42ac-8357-6a3ea77656c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b71184c3b784a6c8662c36cc6a4f873, user_id=73aed356c605492792678ec83716339a, role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:26.694533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e20ff-8047-42ac-8357-6a3ea77656c1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:26.718908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 66/140] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:26 2022] PUT /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/73aed356c605492792678ec83716339a/roles/04c92931c9c541f9af08fe6b22629f71 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:26.758737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:26.790278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d23b3-fd21-43f8-96e9-af2724a34c31 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:26.829196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc37596-6ce2-4710-bb44-5784995cadb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:26.829891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37596-6ce2-4710-bb44-5784995cadb5 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.830227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37596-6ce2-4710-bb44-5784995cadb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.830578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37596-6ce2-4710-bb44-5784995cadb5 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.831383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc37596-6ce2-4710-bb44-5784995cadb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:26.832949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc37596-6ce2-4710-bb44-5784995cadb5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:26.857051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 75/141] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:26 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:31:26.993011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2834e0-726c-4d10-9c79-d9e512dfe3f1 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:26.993375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2834e0-726c-4d10-9c79-d9e512dfe3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:26.993598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2834e0-726c-4d10-9c79-d9e512dfe3f1 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:26.995346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 67/142] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:27.000813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:27.001167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:27.001454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:27.026849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:27.028083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:27.112761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 76/143] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:27.135712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2834e0-726c-4d10-9c79-d9e512dfe3f1 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:27.249247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2834e0-726c-4d10-9c79-d9e512dfe3f1 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:27.287153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:27.287964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:27.288253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:27.288534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:27.296770 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:27.300451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:27.309638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:27.310551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:27.312555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 68/144] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:27.319750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:27.387215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:27.437212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa082a-6e54-47bf-a8d4-22b981884ddd None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:27.475652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:27.476391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:27.476678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:27.476962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:27.477845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:27.478160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:27.479602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:27.489358 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 77/145] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:27.494909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:27.602889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621289c8-24a7-419d-90b3-0e949d14e78c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:27.639106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:27.639966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:27.640263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:27.640551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] PATH_INFO: `/v3/users/a499e83481e340be86d07aae79159c92` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:27.641765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] RBAC: Authorizing `identity:get_user(user_id=a499e83481e340be86d07aae79159c92)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:27.643350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:27.645574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 69/146] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:27 2022] GET /identity/v3/users/a499e83481e340be86d07aae79159c92 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:27.651553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:27.757977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e5c11-f379-4071-8b10-e9da526997e7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:27.783996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:27.799410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbed623-c95e-47c1-8074-a537dbbce4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:27.800281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbed623-c95e-47c1-8074-a537dbbce4d1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:27.800566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbed623-c95e-47c1-8074-a537dbbce4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:27.800842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbed623-c95e-47c1-8074-a537dbbce4d1 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:27.802973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbed623-c95e-47c1-8074-a537dbbce4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:27.804481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbed623-c95e-47c1-8074-a537dbbce4d1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:27.806216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 78/147] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:27 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:27.811985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:27.885190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:27.922350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84aac-b885-446f-a5b1-e14a80619360 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:27.962257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc47c6-b780-4c9d-ba1d-537d1c5394f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:27.963258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc47c6-b780-4c9d-ba1d-537d1c5394f1 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:27.963558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc47c6-b780-4c9d-ba1d-537d1c5394f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:27.963848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc47c6-b780-4c9d-ba1d-537d1c5394f1 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/a499e83481e340be86d07aae79159c92/roles/5f6fa9f4eb5c49329e3ac9e9e22269ad` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:27.965951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc47c6-b780-4c9d-ba1d-537d1c5394f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b71184c3b784a6c8662c36cc6a4f873, user_id=a499e83481e340be86d07aae79159c92, role_id=5f6fa9f4eb5c49329e3ac9e9e22269ad)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:27.967512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc47c6-b780-4c9d-ba1d-537d1c5394f1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:27.986696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 70/148] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:27 2022] PUT /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/users/a499e83481e340be86d07aae79159c92/roles/5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:28.419040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67702b-34aa-42c8-a1f4-657c868cf404 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:28.419573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67702b-34aa-42c8-a1f4-657c868cf404 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:28.419650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67702b-34aa-42c8-a1f4-657c868cf404 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:28.421255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 79/149] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:28.430481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:28.431115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:28.431547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:28.459721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:28.460969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:28.553145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 71/150] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:28.595816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67702b-34aa-42c8-a1f4-657c868cf404 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:28.714674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67702b-34aa-42c8-a1f4-657c868cf404 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:28.762115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:28.762957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:28.763246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:28.763588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:28.775049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:28.782978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:28.783870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:28.785107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 80/151] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:28.792447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:28.866743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:28.919852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bdbe6-6754-46a1-87c9-63a1eeee422b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:28.960299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:28.960958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:28.961258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:28.961588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:28.962381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:28.962695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:28.964102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cfd69-de88-487e-91d2-d56177bb9c77 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:28.973372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 72/152] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:28.978987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:29.042729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:29.056013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb8f1-5eb7-46ab-aaa5-cd166ee69fea None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.056304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb8f1-5eb7-46ab-aaa5-cd166ee69fea None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.056587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb8f1-5eb7-46ab-aaa5-cd166ee69fea None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.057967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 73/153] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:29.075604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701659-8685-44f9-8098-cc99e6af157f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.075891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701659-8685-44f9-8098-cc99e6af157f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.076176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701659-8685-44f9-8098-cc99e6af157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.104963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-89701659-8685-44f9-8098-cc99e6af157f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:29.108831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-89701659-8685-44f9-8098-cc99e6af157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:29.129926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4c67-1159-4250-b8fa-53f42ffdd4b7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:29.188048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:29.188950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.189234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.189514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] PATH_INFO: `/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.192101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] RBAC: Authorizing `identity:get_user(user_id=dc78df0f6ac445d5b0a04a3f9969c79f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:29.193593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:29.195459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 81/154] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:28 2022] GET /identity/v3/users/dc78df0f6ac445d5b0a04a3f9969c79f => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:29.200886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:29.245094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 74/155] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:29.302543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701659-8685-44f9-8098-cc99e6af157f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:29.406787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:29.410974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2241-ff19-453d-a584-251f55ef9341 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:29.456108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:29.474196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701659-8685-44f9-8098-cc99e6af157f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:29.517436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:29.518342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.518784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.519057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:29.519363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.520515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.521042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.521339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.536055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:29.548286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:29.549486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:29.550498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:29.552605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 75/156] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:29.558288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:29.637053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:29.642380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:29.696934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c66b67-99d5-41f5-8508-6e3e091ec317 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:29.718666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:29.745863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:29.747071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.747573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.748052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.749021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] RBAC: Adding query filter params (name=member) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:29.749562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:29.751215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:29.764954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 76/157] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:29.770876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:29.803875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 82/158] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:29.809291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:29.848587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:29.921660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525d770-efc6-477d-b9a8-b7406d382666 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:29.976660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:29.977899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:29.978550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:29.979135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:29.983154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:29.984620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:29.986290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 77/159] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:29 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:29.992601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:30.070813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:30.095300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244118a-95c5-4bae-9005-88d1699a2a3e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:30.175079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:30.176041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.176336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.176620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.177991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:30.179510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:30.181249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 83/160] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:29 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:30.187181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:30.190251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b111-0aca-4037-9c49-f14e36eaf111 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:30.274598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce087743-635e-47bc-913d-3c54a67c7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:30.275509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce087743-635e-47bc-913d-3c54a67c7796 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.275828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce087743-635e-47bc-913d-3c54a67c7796 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.276069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce087743-635e-47bc-913d-3c54a67c7796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.298747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:30.309633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67a772-32b4-44b4-ac98-93047e5aec5b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:30.347400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:30.348674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.349033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.349314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.350224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=dc78df0f6ac445d5b0a04a3f9969c79f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:30.350592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:30.352067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:30.359223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 84/161] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:30 2022] GET /identity/v3/role_assignments?user.id=dc78df0f6ac445d5b0a04a3f9969c79f&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:30.384361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce087743-635e-47bc-913d-3c54a67c7796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:30.385843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce087743-635e-47bc-913d-3c54a67c7796 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:30.450911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:30.525570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 78/162] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:30.531711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:30.570274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a2c26-d098-472e-aee7-e43787e5a4b3 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.570600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a2c26-d098-472e-aee7-e43787e5a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.570878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a2c26-d098-472e-aee7-e43787e5a4b3 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.572343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 79/163] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:30.577633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.577926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.578218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.612068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:30.613240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:30.681196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9b4b4-7907-4595-811d-eb2de4193b69 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:30.720486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:30.722350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.723432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.724193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.725874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:30.727868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:30.730465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 85/164] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:30 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:30.736594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:30.749209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 80/165] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:30.758259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:30.799340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:30.854310 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb158a8-c1f7-404b-9af5-5ae04f6f2d52 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:30.892551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:30.893507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:30.893973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:30.894457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:30.895524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=73aed356c605492792678ec83716339a) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:30.896130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:30.897893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:30.905087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 86/166] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:30 2022] GET /identity/v3/role_assignments?user.id=73aed356c605492792678ec83716339a&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=7847dd8004504fe890aac6ff853967c8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:30.920177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:30.968998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25b10-b9f5-479d-ad24-32d76cce0ffd None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:31.023579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:31.024403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.024934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.025232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.038277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:31.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:31.047402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:31.048348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 81/167] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:31.054435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:31.169609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:31.195335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb43ab7-a6d6-43b6-b336-ffd50b3092df None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:31.233405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:31.234082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.234384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.234677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.235442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:31.235755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:31.237163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ff8a-f2bd-46ce-aa7a-1c2490b765ef None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:31.249024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 87/168] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:31.255197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:31.300353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df38df-92fc-4809-acca-d47d38f6bcea None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.300960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df38df-92fc-4809-acca-d47d38f6bcea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.301428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df38df-92fc-4809-acca-d47d38f6bcea None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.303059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 88/169] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:31.308483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7821a3b-c90e-46f3-be8c-32331dc825fb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.309013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7821a3b-c90e-46f3-be8c-32331dc825fb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.309471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7821a3b-c90e-46f3-be8c-32331dc825fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.333024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b7821a3b-c90e-46f3-be8c-32331dc825fb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:31.335490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b7821a3b-c90e-46f3-be8c-32331dc825fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:31.440003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6dc4-37cd-472f-ba8b-aa851809ab36 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:31.481923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 89/170] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:31.483561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4eced-36dc-46f1-8b36-4170cbb3fb89 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.484037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4eced-36dc-46f1-8b36-4170cbb3fb89 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.484498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4eced-36dc-46f1-8b36-4170cbb3fb89 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.485937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 90/171] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:31.492807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.493289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.493722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.495163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:31.501834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:31.504571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.505048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.505502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.506963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:31.509640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:31.511654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 82/172] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:31 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:31.517080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:31.524282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:31.526838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:31.633549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 91/173] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:31.635251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:31.642512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:31.758772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15ab50-35eb-4f90-a9f2-cb2f46915a36 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:31.767790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5529c-8847-4d5b-81bb-415ac42370ea None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:31.806172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:31.807391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.807910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.808383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.820031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:31.828386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:31.829252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:31.830023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:31.833221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 92/174] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:31.834210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:31.834443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:31.835187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:31.835481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:31.835767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:31.906711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:31.975912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:31.981278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6886f2-06c2-4b87-b638-68d64cd77f37 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:31.985410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:31.992654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.079170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.079920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.080206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.080490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.105487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:32.113750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:32.114863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:32.115656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:32.125182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 93/175] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:32.127417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.149599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 83/176] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:32.150777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.265538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31a38-ae9b-47a5-8062-bfffa1e3fc08 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.273429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:32.279340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48e83-79a1-4ac5-91f4-b23090655c48 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.295506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:32.312488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.313389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.313856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.314276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.315201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:32.315674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.317764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.323502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.323847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.324139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.324422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.325173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:32.325524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.326887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426838-ad5c-4b2d-abab-f73f91688d87 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.327693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 94/177] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:32.328654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.342395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 84/178] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:32.342395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323d8c-9e64-4545-9c94-0c85447c1c8c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.342395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323d8c-9e64-4545-9c94-0c85447c1c8c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.342395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323d8c-9e64-4545-9c94-0c85447c1c8c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.342395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 85/179] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:32.342395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323d8c-9e64-4545-9c94-0c85447c1c8c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.444675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda091-2189-446c-bf27-54a68c2fa893 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.456977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323d8c-9e64-4545-9c94-0c85447c1c8c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.479025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.479926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.480211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.480488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] PATH_INFO: `/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.481692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] RBAC: Authorizing `identity:get_project(project_id=ab9d3d96f9fd4206976edd5b0510fb99)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.483179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.484883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 95/180] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/projects/ab9d3d96f9fd4206976edd5b0510fb99 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:32.485645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.494165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e26ab-3d2d-4004-a0c9-c4d6cc54a8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.495162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e26ab-3d2d-4004-a0c9-c4d6cc54a8fa None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.495439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e26ab-3d2d-4004-a0c9-c4d6cc54a8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.495717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e26ab-3d2d-4004-a0c9-c4d6cc54a8fa None admin] PATH_INFO: `/v3/users/346b4c65c5494fd3aefeefc9ff18f071` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.510125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e26ab-3d2d-4004-a0c9-c4d6cc54a8fa None admin] RBAC: Authorizing `identity:get_user(user_id=346b4c65c5494fd3aefeefc9ff18f071)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.511607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e26ab-3d2d-4004-a0c9-c4d6cc54a8fa None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.513299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 86/181] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/users/346b4c65c5494fd3aefeefc9ff18f071 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:32.514505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee78719-b1ce-414f-827c-cb48d44322ab None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.514790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee78719-b1ce-414f-827c-cb48d44322ab None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.515068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee78719-b1ce-414f-827c-cb48d44322ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.530946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7ee78719-b1ce-414f-827c-cb48d44322ab None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:32.532146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7ee78719-b1ce-414f-827c-cb48d44322ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:32.544991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:32.546032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:32.594590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be137632-03db-4478-bd15-7169c07ba15c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.605165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 87/182] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:32.606634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f795-2a6e-4391-8de1-84581563d591 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.606937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f795-2a6e-4391-8de1-84581563d591 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.607224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f795-2a6e-4391-8de1-84581563d591 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.608586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 88/183] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:32.609689 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71618-cc5e-4d00-a4c8-30bf351bafae None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.609977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71618-cc5e-4d00-a4c8-30bf351bafae None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.610262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71618-cc5e-4d00-a4c8-30bf351bafae None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.611516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 89/184] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:32.614731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d71618-cc5e-4d00-a4c8-30bf351bafae None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.639015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.639916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.640180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.640459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] PATH_INFO: `/v3/users/73aed356c605492792678ec83716339a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.641744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] RBAC: Authorizing `identity:get_user(user_id=73aed356c605492792678ec83716339a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.644022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.646925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 96/185] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/users/73aed356c605492792678ec83716339a => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:32.647597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:32.738076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d71618-cc5e-4d00-a4c8-30bf351bafae None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.766927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d172fb-0954-4931-b58e-352dbb76e403 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:32.780241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.780938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.781227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.781511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.782381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=ab9d3d96f9fd4206976edd5b0510fb99, user.id=73aed356c605492792678ec83716339a) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:32.782715 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.784185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550d7b9-22ad-418c-a9f0-d6a46a5aa9c8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.802395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 90/186] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/role_assignments?user.id=73aed356c605492792678ec83716339a&scope.project.id=ab9d3d96f9fd4206976edd5b0510fb99&role.id=7847dd8004504fe890aac6ff853967c8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:32.802614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:32.802704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6cae-2815-4575-8f3b-6141cb3c72a9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.802704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6cae-2815-4575-8f3b-6141cb3c72a9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.802704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6cae-2815-4575-8f3b-6141cb3c72a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.813684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:32.814377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.814697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.814969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.836539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5aea6cae-2815-4575-8f3b-6141cb3c72a9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:32.838386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5aea6cae-2815-4575-8f3b-6141cb3c72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:32.850269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:32.907090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:32.908590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:32.930101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 91/187] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:32.932618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:32.933130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:32.933553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:32.957412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:32.958674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:33.045490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 97/188] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:33.046383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.048588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 92/189] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:33.049749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.075784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.141911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.169703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c810f-02fc-49e2-92ae-1a8079acf013 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.179436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3884f-15f0-4f84-9780-c41f0a083404 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.209712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.210586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.210863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.211138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.215625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.216287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.216577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.216863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.223805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:33.231637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:33.232567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 98/190] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:33.233648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.299203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.301275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.331554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.354526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c8b32-0a47-4c92-be62-d7a721e1d16f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.375085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.395295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.396010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.396298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.396576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.397791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.399314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.402121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 99/191] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:33.403571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.412042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 93/192] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:33.412956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.525643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01b506-3c8c-4bce-8348-8d05fe20254a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.528908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee108a-f293-43ad-b48e-d28f94e575a0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.559883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.560759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.561046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.561326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.562565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.564063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.565783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 100/193] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:33.566644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.571421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.572241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.572590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.572878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.583870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:33.588599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:33.592167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:33.593024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:33.593912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 94/194] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:33.594589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.632787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.675038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b69e-efab-4fe5-987c-9830231f4b9d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.704607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09808c8b-b26b-48f7-8428-2da43cf32762 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.709706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.710400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.710688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.710967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.711721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:33.712034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.713415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.721390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 101/195] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:33.722171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.738414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.739182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.739475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.739761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.740478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.741945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.768484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 95/196] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:33 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:33.768484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.810983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.836476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbcac8-c705-47a5-9013-90c6ebdb1d32 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.869429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.880144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.881026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.881309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.881587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.882909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.884373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.884731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a17b-0805-43eb-a378-8e44828fd04f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:33.891200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 102/197] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:33.891200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:33.929722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:33.930320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:33.930642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:33.930924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:33.931789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=346b4c65c5494fd3aefeefc9ff18f071) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:33.932113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:33.933615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:33.939872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 96/198] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/role_assignments?user.id=346b4c65c5494fd3aefeefc9ff18f071&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:33.940794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.027588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a970f5-ed5c-4980-abf1-701e03596742 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:34.074495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:34.074761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f04a3-7f8d-4f6e-a93a-b8b179106acc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:34.075614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:34.076066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:34.076545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:34.077328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:34.077645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:34.079687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:34.092461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 103/199] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:34.093638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.111554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:34.128951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:34.130714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:34.131006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:34.131303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] PATH_INFO: `/v3/users/a499e83481e340be86d07aae79159c92` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:34.132539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] RBAC: Authorizing `identity:get_user(user_id=a499e83481e340be86d07aae79159c92)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:34.134003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:34.136052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 97/200] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:33 2022] GET /identity/v3/users/a499e83481e340be86d07aae79159c92 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:34.136990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.170174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:34.234506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631b4cf-b345-4451-943a-a074988d4272 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:34.268852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3b8bf-855c-4908-80c3-6fde3c1e593d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:34.282095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:34.283090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:34.283411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:34.283667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:34.285276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] RBAC: Adding query filter params (role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=73aed356c605492792678ec83716339a) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:34.285616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:34.287418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:34.295799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 104/201] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:34 2022] GET /identity/v3/role_assignments?user.id=73aed356c605492792678ec83716339a&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:34.296917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.327812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:34.328768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:34.329060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:34.329340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] PATH_INFO: `/v3/users/346b4c65c5494fd3aefeefc9ff18f071` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:34.331128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] RBAC: Authorizing `identity:get_user(user_id=346b4c65c5494fd3aefeefc9ff18f071)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:34.334826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:34.336624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 98/202] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:34 2022] GET /identity/v3/users/346b4c65c5494fd3aefeefc9ff18f071 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:34.342483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.383695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:34.424609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5f92-8c2e-47d1-ad06-066d733ceec1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:34.469058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:34.469728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:34.470020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:34.470302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:34.555267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:34.556684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:34.597471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:34.618433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905d68a-8cc0-45e3-87aa-6975bafea781 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:34.681592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:34.688637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:34.689316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:34.689690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:34.689907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:34.741047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 105/203] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:34.746368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.798175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:34.799743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:34.933000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:34.961591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 99/204] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:34.967663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:34.981346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5272b-073b-4c33-971e-47126558fe64 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:35.045386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:35.046264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:35.046572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:35.046847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:35.048101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:35.049550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:35.053076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 106/205] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:34 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:35.058857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:35.141363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:35.169409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94be799-a0e3-4513-b2f2-2bf16410c94a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:35.217239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68005-0e60-472f-b5bc-b65a06fad531 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:35.255512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:35.256181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:35.256466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:35.256740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:35.257644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] RBAC: Adding query filter params (role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873, user.id=a499e83481e340be86d07aae79159c92) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:35.257967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:35.259549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:35.265969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 107/206] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:35 2022] GET /identity/v3/role_assignments?user.id=a499e83481e340be86d07aae79159c92&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:35.287190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e595d-7b51-4155-9682-284444b2fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:35.288097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e595d-7b51-4155-9682-284444b2fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:35.288394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e595d-7b51-4155-9682-284444b2fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:35.288682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e595d-7b51-4155-9682-284444b2fbe8 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:35.290074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e595d-7b51-4155-9682-284444b2fbe8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:35.291690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e595d-7b51-4155-9682-284444b2fbe8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:35.293526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 100/207] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:34 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:35.299582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:35.414073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8046-3577-47ad-8efa-f14fe69d20f2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:35.416523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:35.457882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:35.458590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:35.458882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:35.459164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:35.460014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] RBAC: Adding query filter params (role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=346b4c65c5494fd3aefeefc9ff18f071) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:35.460334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:35.461789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3838f8-b604-427b-9047-e25355750538 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:35.468104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 108/208] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:35 2022] GET /identity/v3/role_assignments?user.id=346b4c65c5494fd3aefeefc9ff18f071&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:36.282281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288426-4ada-4571-a556-26046fc7d573 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.282823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288426-4ada-4571-a556-26046fc7d573 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.282899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288426-4ada-4571-a556-26046fc7d573 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.284343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 101/209] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:36.289970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ecd3c-d01b-4b94-9450-cad7d03fdfc7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.290418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ecd3c-d01b-4b94-9450-cad7d03fdfc7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.290621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ecd3c-d01b-4b94-9450-cad7d03fdfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.308305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5d0ecd3c-d01b-4b94-9450-cad7d03fdfc7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:36.309500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5d0ecd3c-d01b-4b94-9450-cad7d03fdfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.381176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 109/210] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:36.403941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288426-4ada-4571-a556-26046fc7d573 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.415512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1313d-8db1-4264-a010-32448b095ae3 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.415811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1313d-8db1-4264-a010-32448b095ae3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.416094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1313d-8db1-4264-a010-32448b095ae3 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.417488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 110/211] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:36.424124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.424411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.424689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.447454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:36.448674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.498811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:36.533424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 111/212] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:36.541015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288426-4ada-4571-a556-26046fc7d573 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.557864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.577212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b22aa-11b8-4130-82b8-4139fa087e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.578386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b22aa-11b8-4130-82b8-4139fa087e19 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.578937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b22aa-11b8-4130-82b8-4139fa087e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.579403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b22aa-11b8-4130-82b8-4139fa087e19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.588405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:36.591742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b22aa-11b8-4130-82b8-4139fa087e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-c60b22aa-11b8-4130-82b8-4139fa087e19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:36.601900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:36.602852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:36.603735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:36.606137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 102/213] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:36.607632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15bca5-31df-40e1-a7ec-617bc63911c5 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.607921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15bca5-31df-40e1-a7ec-617bc63911c5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.608386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15bca5-31df-40e1-a7ec-617bc63911c5 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.609823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 103/214] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:36.614174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15bca5-31df-40e1-a7ec-617bc63911c5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.677126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860e75-dd9e-47a5-9e26-a2857ff178a2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.715709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bca35a-f8dc-4ff7-88f3-4ec59d88dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.716520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca35a-f8dc-4ff7-88f3-4ec59d88dec0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.716801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca35a-f8dc-4ff7-88f3-4ec59d88dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.717081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca35a-f8dc-4ff7-88f3-4ec59d88dec0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.728199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bca35a-f8dc-4ff7-88f3-4ec59d88dec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:36.730773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15bca5-31df-40e1-a7ec-617bc63911c5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-16bca35a-f8dc-4ff7-88f3-4ec59d88dec0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:36.735915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:36.736801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:36.737586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 112/215] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:36.739060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.739060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.739360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.754442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:36.756796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:36.758015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.775393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.776083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.776382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.776667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.777434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:36.777749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.779163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.787962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 104/216] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:36.791633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.831097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 113/217] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:36.832792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.855745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:36.908500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527beb-a039-4874-bba3-1fe3561ae99c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.942976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.943646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.943933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.944215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.944740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23882-477e-4786-8d7f-b5a2e4a74116 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.944967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:36.945277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.946695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.962424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 105/218] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:36.963478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.982822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.983704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.983992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.984333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] PATH_INFO: `/v3/users/346b4c65c5494fd3aefeefc9ff18f071` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.985546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=346b4c65c5494fd3aefeefc9ff18f071)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.987051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.989670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 114/219] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/users/346b4c65c5494fd3aefeefc9ff18f071 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:36.990487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.019774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.083744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.084815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099efe3-3ab8-4ceb-a5fb-5d474f66ffc0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.099873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1821-4a0e-41d1-ae0e-37573e727dd7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.124567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.125653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.125936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.126215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.127693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.129263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.134578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 106/220] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:37.134578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.138960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.139850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.140132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.140417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] PATH_INFO: `/v3/users/51eb044f89c540e1811e06213e2ded70` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.155558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] RBAC: Authorizing `identity:get_user(user_id=51eb044f89c540e1811e06213e2ded70)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.157072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.159146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 115/221] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/users/51eb044f89c540e1811e06213e2ded70 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:37.164450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.236969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb616d-cb95-47c0-ac7a-6cd4eb16604f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.246317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.271885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520d39-dbed-4bc5-adf3-e4b1b573ccc5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.272829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.273694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.273980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.274249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.275736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.277196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.278961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 107/222] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:37 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:37.279725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.312580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.313873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.314389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.314747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.315468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.317040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.334164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.339296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 116/223] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:37 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:37.352303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.402139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0afe7-8444-4e4d-8b7d-8f29e882f3a4 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.451817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.453575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.453933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.454288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.487601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38df2-cbac-4be1-a8a8-33844d974a46 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.521135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.538504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928922d-0284-4e81-89fd-d8578aca3c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.539432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928922d-0284-4e81-89fd-d8578aca3c2c None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.539713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928922d-0284-4e81-89fd-d8578aca3c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.539987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928922d-0284-4e81-89fd-d8578aca3c2c None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/346b4c65c5494fd3aefeefc9ff18f071/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.541972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928922d-0284-4e81-89fd-d8578aca3c2c None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a50f239f344388ad3bbaba1cac2730, user_id=346b4c65c5494fd3aefeefc9ff18f071, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.544255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928922d-0284-4e81-89fd-d8578aca3c2c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.550564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.552921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.558978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 117/224] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:37 2022] PUT /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/346b4c65c5494fd3aefeefc9ff18f071/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:37.601705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e13f0-3ae7-474b-a796-c21b91e5ab70 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.601996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e13f0-3ae7-474b-a796-c21b91e5ab70 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.602184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e13f0-3ae7-474b-a796-c21b91e5ab70 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.603605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 118/225] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:37.609095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.609382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.609673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.628577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:37.630500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:37.686120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 108/226] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:37.693259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.711749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.730753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 119/227] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:37.754714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.796827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:37.825203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8617e1-f6e5-43db-b7fc-b7339bff8570 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.865209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.865995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.866276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.866582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.867794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:37.869356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:37.871108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 109/228] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:37 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:37.876889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.888731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fbe27-3ab2-40c1-9dcd-c623b6736bde None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:37.935195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:37.936023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:37.936308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:37.936586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:37.947749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:37.957650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:37.958726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:37.959510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 120/229] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:37.971657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:37.987104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607bd9-6b2e-48be-97c8-126797258ac8 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:38.026426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:38.027487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:38.028042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:38.028325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:38.029331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=51eb044f89c540e1811e06213e2ded70) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:38.029649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:38.030061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:38.031451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:38.039752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 110/230] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:37 2022] GET /identity/v3/role_assignments?user.id=51eb044f89c540e1811e06213e2ded70&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=7847dd8004504fe890aac6ff853967c8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:38.138985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed986-fb75-448e-9c78-3b4723974abb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:38.200974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:38.202056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:38.202572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:38.203083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:38.204063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:38.204577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:38.206196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:38.220503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 121/231] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:38.227109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:38.240413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:38.363643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064134-094e-4515-891c-ff4432c75fb9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:38.413686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:38.414527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:38.414813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:38.415088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] PATH_INFO: `/v3/users/346b4c65c5494fd3aefeefc9ff18f071` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:38.416349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=346b4c65c5494fd3aefeefc9ff18f071)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:38.417792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:38.419766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 111/232] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:38 2022] GET /identity/v3/users/346b4c65c5494fd3aefeefc9ff18f071 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:38.424971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:38.581512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621366fd-190b-478a-b21f-024f948d0cf1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:38.600887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:38.636011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5604f16-7f69-47f8-b931-c15788c2c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:38.637234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604f16-7f69-47f8-b931-c15788c2c037 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:38.637718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604f16-7f69-47f8-b931-c15788c2c037 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:38.638216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604f16-7f69-47f8-b931-c15788c2c037 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:38.639632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5604f16-7f69-47f8-b931-c15788c2c037 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:38.641271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5604f16-7f69-47f8-b931-c15788c2c037 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:38.644160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 122/233] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:38 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:38.649484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:38.760000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:38.785668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fabb4-509e-4ff4-aeb8-1fe16f181ce5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:38.821139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d2fa-065b-46d3-8594-6d3d986441f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:38.822033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d2fa-065b-46d3-8594-6d3d986441f6 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:38.822317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d2fa-065b-46d3-8594-6d3d986441f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:38.822624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d2fa-065b-46d3-8594-6d3d986441f6 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/346b4c65c5494fd3aefeefc9ff18f071/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:38.824843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d2fa-065b-46d3-8594-6d3d986441f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a50f239f344388ad3bbaba1cac2730, user_id=346b4c65c5494fd3aefeefc9ff18f071, role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:38.826292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d2fa-065b-46d3-8594-6d3d986441f6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:38.841124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 112/234] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:38 2022] PUT /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/346b4c65c5494fd3aefeefc9ff18f071/roles/04c92931c9c541f9af08fe6b22629f71 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:39.875526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46b38a-2360-45ff-a319-23d8b1eb2cb2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:39.876541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46b38a-2360-45ff-a319-23d8b1eb2cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:39.877031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46b38a-2360-45ff-a319-23d8b1eb2cb2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:39.879184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 123/235] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:39.884741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9084-f61e-495e-813c-3324c1f02775 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:39.885561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9084-f61e-495e-813c-3324c1f02775 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:39.886043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9084-f61e-495e-813c-3324c1f02775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:39.911353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-229b9084-f61e-495e-813c-3324c1f02775 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:39.912890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-229b9084-f61e-495e-813c-3324c1f02775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:40.007831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 113/236] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:40.048787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46b38a-2360-45ff-a319-23d8b1eb2cb2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.090581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4dc9-3eba-4d48-ad25-360e6d6f6195 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.091211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4dc9-3eba-4d48-ad25-360e6d6f6195 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.091807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4dc9-3eba-4d48-ad25-360e6d6f6195 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.093894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 114/237] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:40.104624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.105226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.105577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.140527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:40.142579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:40.206110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46b38a-2360-45ff-a319-23d8b1eb2cb2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:40.257623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:40.258572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.258802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.259125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.271259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:40.274698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:40.279344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:40.281114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:40.281885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:40.285496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 124/238] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:40.286915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.292745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 115/239] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:40.331886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:40.335975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.395033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce50a2-2368-4820-ab67-427876449751 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:40.430752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:40.431696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.432138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.432557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.433440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:40.433889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:40.435450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:40.445386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 125/240] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:40.450939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.504892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee989-32f3-462b-a547-2b1ca44cf1dc None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:40.541706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95d681-129b-4426-81c6-4133464e63ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:40.542462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95d681-129b-4426-81c6-4133464e63ef None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.542758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95d681-129b-4426-81c6-4133464e63ef None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.543039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95d681-129b-4426-81c6-4133464e63ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.544248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95d681-129b-4426-81c6-4133464e63ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:40.545804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95d681-129b-4426-81c6-4133464e63ef None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:40.547894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 116/241] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:40.549247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674af20-ecff-4163-ac81-01f12f75fc25 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.549542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674af20-ecff-4163-ac81-01f12f75fc25 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.549827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674af20-ecff-4163-ac81-01f12f75fc25 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.552067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 117/242] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:40.558291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.558661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.558944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.565886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ad78-1460-4f47-bff5-763f003137c3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:40.568902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:40.583750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:40.585477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:40.614062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:40.615037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.615327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.615611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] PATH_INFO: `/v3/users/cb7f7dbb9f97417b883c1c78aa701ca2` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.634708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7f7dbb9f97417b883c1c78aa701ca2)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:40.636236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:40.638757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 126/243] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:40 2022] GET /identity/v3/users/cb7f7dbb9f97417b883c1c78aa701ca2 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:40.639531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.658792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:40.669723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 118/244] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:40.669876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.762718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83208-3da2-4314-8372-fd7d0d272640 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:40.783019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a991e7-1c13-4dc2-bc54-2a205ad88a6e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:40.797662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfecbdd-79bb-4f19-bf18-ff8c2003f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:40.798273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecbdd-79bb-4f19-bf18-ff8c2003f9c8 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.798609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecbdd-79bb-4f19-bf18-ff8c2003f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.798896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecbdd-79bb-4f19-bf18-ff8c2003f9c8 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.799607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecbdd-79bb-4f19-bf18-ff8c2003f9c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:40.801607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecbdd-79bb-4f19-bf18-ff8c2003f9c8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:40.822236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:40.823136 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 127/245] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:40 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:40.823360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.823789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.824261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.836091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb5ae1-9c82-4144-9184-7c78849597ca None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:40.836398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb5ae1-9c82-4144-9184-7c78849597ca None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:40.836693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb5ae1-9c82-4144-9184-7c78849597ca None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:40.838082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 128/246] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:40.842402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb5ae1-9c82-4144-9184-7c78849597ca None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:40.870907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:40.916442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:40.930911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:40.933798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:40.986974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb5ae1-9c82-4144-9184-7c78849597ca None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.032761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2792ef-3da5-4d50-830b-fc1c21dc7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.033913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2792ef-3da5-4d50-830b-fc1c21dc7356 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.035992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2792ef-3da5-4d50-830b-fc1c21dc7356 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.036499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2792ef-3da5-4d50-830b-fc1c21dc7356 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.049458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2792ef-3da5-4d50-830b-fc1c21dc7356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6f2792ef-3da5-4d50-830b-fc1c21dc7356 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:41.060155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:41.061050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:41.061841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 129/247] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:41.068226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.068516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.069107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.077510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 119/248] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:41.078873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.091045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:41.092160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:41.186877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 130/249] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:41.187824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.207202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:41.216628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:41.219132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd57b2-6390-47f6-84d2-85b69288b63b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.266605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.267290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.267576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.267865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.268735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:41.269156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:41.272092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:41.281939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 120/250] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:41.282612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.335538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cca48-8dd1-4876-b09c-9f3050b592ea None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.376223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.377389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.377628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.377911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.380191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:41.381657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:41.383877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 131/251] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:41.384726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.415638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79108333-95d1-431e-8053-0f49df4f5c58 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.463418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.464225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.464512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.464790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.477119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:41.486265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:41.487176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:41.487953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 121/252] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:41.489151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.509125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:41.514788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:41.569127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743206-efbf-4871-a072-192e006f3e83 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.623840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.625265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.625729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.626182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] PATH_INFO: `/v3/users/346b4c65c5494fd3aefeefc9ff18f071` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.626373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd412d-908d-4d64-b125-f0c23e5cef6c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.628064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] RBAC: Authorizing `identity:get_user(user_id=346b4c65c5494fd3aefeefc9ff18f071)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:41.631406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:41.633604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 132/253] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/users/346b4c65c5494fd3aefeefc9ff18f071 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:41.635232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.663789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.664457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.664747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.665035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.665873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] RBAC: Adding query filter params (role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=cb7f7dbb9f97417b883c1c78aa701ca2) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:41.666191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:41.673097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b10e1-e81a-4c8b-aaaf-9b0bfc999187 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:41.685712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 122/254] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/role_assignments?user.id=cb7f7dbb9f97417b883c1c78aa701ca2&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:41.694414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acee19-ec62-4949-bd8e-cf4940978998 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.694414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acee19-ec62-4949-bd8e-cf4940978998 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.694414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acee19-ec62-4949-bd8e-cf4940978998 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.694414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 123/255] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:41.694414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acee19-ec62-4949-bd8e-cf4940978998 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:41.836669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3500a-1524-4be8-8edc-9301c2fe7225 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.837534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:41.860724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acee19-ec62-4949-bd8e-cf4940978998 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:41.879930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.881067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.881494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.882007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.883006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:41.883535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:41.885229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0fb4a-1780-4395-8aa7-f6bdc00c1b6f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:41.894535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 133/256] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:41.896260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.896753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.897253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.900854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:41.901516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:41.901803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:41.902085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:41.904645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:41.927536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:41.929326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:41.977678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:41.979191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:42.074761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:42.093100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 124/257] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:42.095647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.105742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 134/258] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:42.107233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.266693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6754387-c923-4c43-bc3c-520ce1e27dd7 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.304555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:42.305781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:42.306265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:42.306699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf156f-5ba9-459a-9aad-468abf02147b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.306972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] PATH_INFO: `/v3/users/51eb044f89c540e1811e06213e2ded70` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:42.308537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] RBAC: Authorizing `identity:get_user(user_id=51eb044f89c540e1811e06213e2ded70)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:42.310293 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:42.312182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 125/259] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/users/51eb044f89c540e1811e06213e2ded70 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:42.313142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.351539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:42.352392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:42.352678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:42.352959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:42.354174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:42.356457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:42.357608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 135/260] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:42.358395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.361006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:42.373112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:42.429386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e8bd3-a036-44e2-8679-6dd1b00baf1f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.467257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:42.468445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:42.468930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:42.469033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b88c-1d5b-4e00-8245-33a764502cb9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.469515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:42.481683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:42.490763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:42.491653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:42.492436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:42.500457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 126/261] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:42.501668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.507180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:42.508060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:42.508345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:42.508653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:42.510729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:42.511587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:42.513306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 136/262] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:42.514409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.617878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:42.664319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d3a8-6168-4063-ac69-f4b0f83e9e82 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.703871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e998482-092b-415a-85d4-0e853f8b697a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.720229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:42.733308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:42.733978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:42.734261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:42.734560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:42.735316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:42.735624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:42.737001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:42.757085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 137/263] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:42.757889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.768584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:42.769925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:42.770211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:42.770516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:42.771362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=346b4c65c5494fd3aefeefc9ff18f071) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:42.771677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:42.773243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:42.780639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 127/264] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/role_assignments?user.id=346b4c65c5494fd3aefeefc9ff18f071&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:42.781431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:42.961205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6582-c177-49e9-a8d3-fbb2c82ddee2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:42.993384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76946-e5a8-428d-83f1-4dd34b4c0850 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:43.032027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:43.042786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:43.043992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.044497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.051463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/51eb044f89c540e1811e06213e2ded70/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.054265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a50f239f344388ad3bbaba1cac2730, user_id=51eb044f89c540e1811e06213e2ded70, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:43.055972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:43.079211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:43.080502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.081025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.083750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] PATH_INFO: `/v3/users/346b4c65c5494fd3aefeefc9ff18f071` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.091804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 138/265] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:42 2022] PUT /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/51eb044f89c540e1811e06213e2ded70/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:43.093203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] RBAC: Authorizing `identity:get_user(user_id=346b4c65c5494fd3aefeefc9ff18f071)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:43.095073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:43.097508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 128/266] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:42 2022] GET /identity/v3/users/346b4c65c5494fd3aefeefc9ff18f071 => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:43.102758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:43.224997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb85a6-0a43-4496-bbdd-03fe76d8a792 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:43.268907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c3504-001f-470f-9944-866eb8460ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:43.270051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3504-001f-470f-9944-866eb8460ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.270548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3504-001f-470f-9944-866eb8460ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.271039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3504-001f-470f-9944-866eb8460ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.349852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:43.367644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c3504-001f-470f-9944-866eb8460ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:43.369531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c3504-001f-470f-9944-866eb8460ce1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:43.505281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 139/267] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:43.510912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:43.570882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:43.641346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30096ec3-045b-472c-945a-edbc7f26e563 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:43.709987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7d4d3-950c-464d-b07f-0969af613da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:43.710900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d4d3-950c-464d-b07f-0969af613da3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.711187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d4d3-950c-464d-b07f-0969af613da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.711469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d4d3-950c-464d-b07f-0969af613da3 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.715101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d4d3-950c-464d-b07f-0969af613da3 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:43.716751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d4d3-950c-464d-b07f-0969af613da3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:43.717830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be168-1999-4b56-afe9-5ca8f2940b02 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.718249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be168-1999-4b56-afe9-5ca8f2940b02 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.718689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be168-1999-4b56-afe9-5ca8f2940b02 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.718793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 129/268] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:43 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:43.720057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 140/269] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:43.725755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be168-1999-4b56-afe9-5ca8f2940b02 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:43.726174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ae490-d14c-458c-b5ce-84672274a024 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.726454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ae490-d14c-458c-b5ce-84672274a024 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.726745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ae490-d14c-458c-b5ce-84672274a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.744632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e09ae490-d14c-458c-b5ce-84672274a024 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:43.745833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e09ae490-d14c-458c-b5ce-84672274a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:43.837802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 130/270] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:43.839504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa89e-3280-48e8-b4a1-66785223e2c3 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.840006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa89e-3280-48e8-b4a1-66785223e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.840487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa89e-3280-48e8-b4a1-66785223e2c3 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.842004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 131/271] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:43.848077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.848824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.849331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.876143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:43.876979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:43.878550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:43.887727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be168-1999-4b56-afe9-5ca8f2940b02 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:43.918455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:43.927125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:43.927737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:43.928095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:43.928441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:43.929364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] RBAC: Adding query filter params (role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=346b4c65c5494fd3aefeefc9ff18f071) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:43.929750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:43.931349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:43.938480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 141/272] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:43 2022] GET /identity/v3/role_assignments?user.id=346b4c65c5494fd3aefeefc9ff18f071&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:43.939465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:43.968871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 132/273] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:44.007337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.131737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b8f74-b905-4b5c-ab71-d68d640060e3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.140610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd2b0-6d52-4072-9979-102fcc001cc8 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.170352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.171429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.171859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.172303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.180145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.181060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.181235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.181521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.182757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:44.184221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:44.184617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:44.185869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 133/274] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:44.191948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:44.193802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:44.194897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:44.195901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:44.198236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 142/275] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:44.207673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.230954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:44.232923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:44.312469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112400-ca21-4194-b8ae-8ef32c55163d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.334608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4aed-c4f2-4407-8908-4863a6aaef1c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.357077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852dd8-5da1-4e56-a0f2-4fa053695e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.357773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852dd8-5da1-4e56-a0f2-4fa053695e08 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.358064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852dd8-5da1-4e56-a0f2-4fa053695e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.358350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852dd8-5da1-4e56-a0f2-4fa053695e08 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.359732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49852dd8-5da1-4e56-a0f2-4fa053695e08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:44.361491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49852dd8-5da1-4e56-a0f2-4fa053695e08 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:44.375666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.376387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.376674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.376992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.377829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:44.378140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:44.379591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc41a5-4eea-4198-abc4-16b8ff3953f2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:44.389393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 143/276] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:44.391067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8fbc-c94b-43b7-8daa-142a8c57678e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.391548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8fbc-c94b-43b7-8daa-142a8c57678e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.392012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8fbc-c94b-43b7-8daa-142a8c57678e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.393840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 144/277] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:44.394180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 134/278] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:31:44 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:31:44.395599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8fbc-c94b-43b7-8daa-142a8c57678e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.404769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.405125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.405411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.424917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:44.426946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:44.506826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:44.509609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 135/279] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:44.527467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.534860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8fbc-c94b-43b7-8daa-142a8c57678e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.555217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:44.585922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.587259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.587635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.587828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] PATH_INFO: `/v3/users/5c9282bc2e794fa49c231c5eaea7c0ec` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.607843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] RBAC: Authorizing `identity:get_user(user_id=5c9282bc2e794fa49c231c5eaea7c0ec)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:44.609717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:44.611755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 145/280] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/users/5c9282bc2e794fa49c231c5eaea7c0ec => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:44.619023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.649038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fefa8-dfba-4ab8-a358-172797560cbb None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.711959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.713688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.713993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.714286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.728626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:44.736820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:44.737702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:44.739600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 136/281] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:44.747188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:44.760212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe1b2-a852-4ea3-a2b0-696dceca65bc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.820725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.821601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.822037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.822464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.824005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, user.id=5c9282bc2e794fa49c231c5eaea7c0ec, scope.system=all) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:44.824432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:44.826722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:44.830748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:44.838389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 146/282] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/role_assignments?user.id=5c9282bc2e794fa49c231c5eaea7c0ec&scope.system=all&role.id=7847dd8004504fe890aac6ff853967c8 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:44.867855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:44.891054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d41f-1c71-4562-bf76-548cfaa8c2c2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:44.932253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:44.932873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:44.933165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:44.933448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:44.934219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:44.934556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:44.935984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:44.946550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 137/283] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:44.953726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:45.069144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18bf3a-c50f-4060-93b1-80ca92dba49b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:45.107585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:45.108472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:45.108760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:45.109045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] PATH_INFO: `/v3/users/cb7f7dbb9f97417b883c1c78aa701ca2` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:45.110396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7f7dbb9f97417b883c1c78aa701ca2)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:45.111915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:45.114018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 147/284] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:44 2022] GET /identity/v3/users/cb7f7dbb9f97417b883c1c78aa701ca2 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:45.119431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:45.227530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45a9b-1977-4ba9-ae15-d29c08634b0d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:45.265337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45444e4e-a2f2-406a-8a11-34ba015848d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:45.266216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45444e4e-a2f2-406a-8a11-34ba015848d7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:45.266532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45444e4e-a2f2-406a-8a11-34ba015848d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:45.266815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45444e4e-a2f2-406a-8a11-34ba015848d7 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:45.268024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45444e4e-a2f2-406a-8a11-34ba015848d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:45.270028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45444e4e-a2f2-406a-8a11-34ba015848d7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:45.272087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 138/285] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:45 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:45.277889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:45.364989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:45.421438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f18cf-9e87-435e-9984-2f4f5d8276b1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:45.474374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938525d-b9a1-4664-8c25-84352d0b961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:45.475639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938525d-b9a1-4664-8c25-84352d0b961b None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:45.476127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938525d-b9a1-4664-8c25-84352d0b961b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:45.476604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938525d-b9a1-4664-8c25-84352d0b961b None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/cb7f7dbb9f97417b883c1c78aa701ca2/roles/5f6fa9f4eb5c49329e3ac9e9e22269ad` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:45.478979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938525d-b9a1-4664-8c25-84352d0b961b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a50f239f344388ad3bbaba1cac2730, user_id=cb7f7dbb9f97417b883c1c78aa701ca2, role_id=5f6fa9f4eb5c49329e3ac9e9e22269ad)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:45.480645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938525d-b9a1-4664-8c25-84352d0b961b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:45.512357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 148/286] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:31:45 2022] PUT /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730/users/cb7f7dbb9f97417b883c1c78aa701ca2/roles/5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:45.806416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00134384-02a7-45a9-b409-bdac37a70532 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:45.806754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00134384-02a7-45a9-b409-bdac37a70532 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:45.806951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00134384-02a7-45a9-b409-bdac37a70532 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:45.808421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 139/287] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:45.813841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:45.814142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:45.814456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:45.835902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:45.837448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:45.916116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 149/288] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:45.943578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00134384-02a7-45a9-b409-bdac37a70532 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:45.960725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:46.071177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00134384-02a7-45a9-b409-bdac37a70532 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:46.106457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:46.107265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:46.107543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:46.107827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:46.127242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:46.135187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:46.136046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:46.136825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:46.141355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 140/289] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:46.147868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:46.271222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:46.299768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185004a-bbd4-4b7f-a139-aedafa327d79 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:46.337629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:46.338617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:46.338905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:46.339181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:46.340207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:46.340518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:46.341894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:46.351832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 150/290] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:46.357280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:46.469924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:46.529116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed3c94-8599-4682-97dd-925f7bebe8ad None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:46.589472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:46.590278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:46.590597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:46.590881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] PATH_INFO: `/v3/users/51eb044f89c540e1811e06213e2ded70` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:46.595079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=51eb044f89c540e1811e06213e2ded70)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:46.596548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:46.598638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 141/291] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:46 2022] GET /identity/v3/users/51eb044f89c540e1811e06213e2ded70 => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:46.604446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:46.722594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467630e8-a664-45b8-8ba3-c2b59af173e2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:46.743708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:46.758596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b749f0-2a88-4d2d-8b32-f968a6b67d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:46.759308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b749f0-2a88-4d2d-8b32-f968a6b67d0a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:46.759755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b749f0-2a88-4d2d-8b32-f968a6b67d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:46.760096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b749f0-2a88-4d2d-8b32-f968a6b67d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:46.832618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b749f0-2a88-4d2d-8b32-f968a6b67d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:46.834085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b749f0-2a88-4d2d-8b32-f968a6b67d0a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:46.936078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 151/292] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:46.941449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.075908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f3d0-65bf-46b8-8bf8-ce0692a340f5 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.076228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f3d0-65bf-46b8-8bf8-ce0692a340f5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.076476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f3d0-65bf-46b8-8bf8-ce0692a340f5 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.077849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 152/293] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:47.087896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.088187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.088476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.096776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9820b6-57f3-415f-9411-d1e3af9d2ba4 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:47.129216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:47.130525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:47.134089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:47.135522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.135987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.136438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.137832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:47.139521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:47.141530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 142/294] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:46 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:47.151250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.165683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:47.182725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:47.277677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 153/295] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:47.300186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.326483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d423f-6a5b-437a-a78f-e26b9ee39cac None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:47.392266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:47.392922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.394704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.394998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.395848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=51eb044f89c540e1811e06213e2ded70) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:47.396159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:47.397608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f712e9-0b08-430b-9dbf-99d35c605b7c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:47.404300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 143/296] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/role_assignments?user.id=51eb044f89c540e1811e06213e2ded70&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=7847dd8004504fe890aac6ff853967c8 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:47.483615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c525-205f-4c58-8ae0-f7a1a7836c2c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.483905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c525-205f-4c58-8ae0-f7a1a7836c2c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.484188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c525-205f-4c58-8ae0-f7a1a7836c2c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.485808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 144/297] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:47.494563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559ef-fbd7-4629-b9cd-ba2cb09c228d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.494851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559ef-fbd7-4629-b9cd-ba2cb09c228d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.495134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559ef-fbd7-4629-b9cd-ba2cb09c228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.497643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5ce4-9651-4c98-ac1a-110ee3048046 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:47.526058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f40559ef-fbd7-4629-b9cd-ba2cb09c228d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:47.529769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f40559ef-fbd7-4629-b9cd-ba2cb09c228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:47.549076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:47.550167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.552598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.553079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.576714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:47.586807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:47.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:47.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:47.590963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 154/298] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:47.598987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.616150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:47.653915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 145/299] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:47.655365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bf48f-f439-4f46-b7ec-81baa8c0eacd None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.655544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bf48f-f439-4f46-b7ec-81baa8c0eacd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.655788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bf48f-f439-4f46-b7ec-81baa8c0eacd None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.657179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 146/300] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:47.666024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.666301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.666749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.674822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:47.691077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:47.693229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:47.744021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338fca-5ae6-42e5-bc66-23630ac30726 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:47.778778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 147/301] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:47.780406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.788759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:47.789502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.789795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.790077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.791349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:47.791672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:47.793064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:47.808979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 155/302] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:47.808979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.881421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:47.896956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cff5d2-dc8c-4c43-a3cf-40eb5e37a952 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:47.916944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9428e26-7534-451e-9b8f-8b9f36adb57c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:47.928384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:47.934801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:47.935608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.935890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.936169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.946930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:47.953175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:47.953980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:47.954265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:47.954579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:47.954848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:47.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:47.956478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 148/303] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:47.957755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:47.958444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:47.959894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:47.961630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 156/304] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:47.962982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.066971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786004c2-3d70-4b25-9c7c-ed13d091dddd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.074528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1dd4d-cc90-403f-85e2-eb4166f908d1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.101169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.102037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.102333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.102646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] PATH_INFO: `/v3/users/2c3c5210a59c4368a498dd72e63759cc` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.111419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.112393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.112906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.113498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.114601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:48.115130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.116589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3c5210a59c4368a498dd72e63759cc)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.116835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.118079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.119848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 149/305] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/users/2c3c5210a59c4368a498dd72e63759cc => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:48.120601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.129516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 157/306] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:48.130544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.136521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.178176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.231708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18caf6-0c46-4a20-9110-f1be37753232 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.242748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7980526-16b1-4a4d-90b0-eca75cb17f7d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.268210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.268878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.269313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.269589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] PATH_INFO: `/v3/groups` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.270279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.271748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.278609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.279269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.279554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.279831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.280667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] RBAC: Adding query filter params (role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad, user.id=2c3c5210a59c4368a498dd72e63759cc, scope.system=all) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:48.280981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.282458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442467f-3fdb-4368-92d6-fd95df4b26b0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.285929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 150/307] 10.222.0.64 () {60 vars in 1134 bytes} [Tue Jul 19 15:31:48 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:31:48.286803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.288188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 158/308] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 19 15:31:48 2022] GET /identity/v3/role_assignments?user.id=2c3c5210a59c4368a498dd72e63759cc&scope.system=all&role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:48.289404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926976c-e0fc-4ba1-b1c5-164c0ad2e327 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.289697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926976c-e0fc-4ba1-b1c5-164c0ad2e327 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.289979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926976c-e0fc-4ba1-b1c5-164c0ad2e327 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.291656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 159/309] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:48.297689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.298007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.298270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.320217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:48.321530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:48.406761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.412243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 160/310] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:48.434049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.435471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3124de-c345-4bea-853a-67b4c6646795 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.448000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.479816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.480890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.480890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.481106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] PATH_INFO: `/v3/users/5c9282bc2e794fa49c231c5eaea7c0ec` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.483120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] RBAC: Authorizing `identity:get_user(user_id=5c9282bc2e794fa49c231c5eaea7c0ec)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.484733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.490718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 151/311] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:48 2022] GET /identity/v3/users/5c9282bc2e794fa49c231c5eaea7c0ec => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:48.493281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.565880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d464576-0fc1-43bc-87e3-e2d9f44cbb7c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.602869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.603673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.603960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.604243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.615430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:48.615918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc75f5-300d-4018-9660-80d960d4b867 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:48.623496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:48.624421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:48.625631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 161/312] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:48.631702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.654853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.656250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.656534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.657083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] PATH_INFO: `/v3/system/users/5c9282bc2e794fa49c231c5eaea7c0ec/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.659273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c9282bc2e794fa49c231c5eaea7c0ec, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.661453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.684178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 152/313] 10.222.0.64 () {58 vars in 1334 bytes} [Tue Jul 19 15:31:48 2022] PUT /identity/v3/system/users/5c9282bc2e794fa49c231c5eaea7c0ec/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:31:48.710687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.767077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094445-80c3-4cf2-bafc-c2ad9ba76b6e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.808579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.809564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.810057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.810558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.811569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:48.812058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.813639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.824269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 162/314] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:48.830321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:48.883311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.946016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db855d-adcf-46e9-98d1-1f3122dc8406 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:48.981320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:48.982233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:48.982552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:48.982833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] PATH_INFO: `/v3/users/cb7f7dbb9f97417b883c1c78aa701ca2` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:48.984045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7f7dbb9f97417b883c1c78aa701ca2)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:48.985495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:48.987461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 153/315] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:48 2022] GET /identity/v3/users/cb7f7dbb9f97417b883c1c78aa701ca2 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:48.993825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:49.102338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca1d5f-bb5b-4926-9741-82f3bb6288d2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:49.120908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:49.144541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:49.145437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:49.145733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:49.146016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:49.219195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:49.220922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:49.337567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 163/316] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:49.343283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:49.455351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd32052-1c04-43d6-9314-ae4813b9a967 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:49.468908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:49.497545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c90fd-faa7-4949-9c53-fcf17e48327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:49.498429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c90fd-faa7-4949-9c53-fcf17e48327e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:49.498721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c90fd-faa7-4949-9c53-fcf17e48327e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:49.498999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c90fd-faa7-4949-9c53-fcf17e48327e None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:49.500206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c90fd-faa7-4949-9c53-fcf17e48327e None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:49.501662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c90fd-faa7-4949-9c53-fcf17e48327e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:49.504321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 154/317] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:49 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:49.510154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:49.560423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:49.626338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773cd6-b499-4275-a83e-dff4a10d2cf1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:49.673749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:49.674772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:49.675312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:49.675796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:49.676842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] RBAC: Adding query filter params (role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad, scope.project.id=e3a50f239f344388ad3bbaba1cac2730, user.id=cb7f7dbb9f97417b883c1c78aa701ca2) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:49.677354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:49.679038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04d056-5589-4dce-bc3a-de8725a38768 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:49.686112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 164/318] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:31:49 2022] GET /identity/v3/role_assignments?user.id=cb7f7dbb9f97417b883c1c78aa701ca2&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:50.390933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466f9b-6508-4241-9db0-27bfe5570595 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.391448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466f9b-6508-4241-9db0-27bfe5570595 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.391523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466f9b-6508-4241-9db0-27bfe5570595 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.392843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 155/319] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:50.398663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00618c97-ab78-489f-8723-d5bf3ecb46f9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.399067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00618c97-ab78-489f-8723-d5bf3ecb46f9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.399228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00618c97-ab78-489f-8723-d5bf3ecb46f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.417111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-00618c97-ab78-489f-8723-d5bf3ecb46f9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:50.418329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-00618c97-ab78-489f-8723-d5bf3ecb46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:50.489925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 165/320] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:50.498170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47d783-0ca5-4074-97e5-2d79f2e3a8d6 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.498499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47d783-0ca5-4074-97e5-2d79f2e3a8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.498781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47d783-0ca5-4074-97e5-2d79f2e3a8d6 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.500294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 156/321] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:50.505297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.505600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.505887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.512005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47d783-0ca5-4074-97e5-2d79f2e3a8d6 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:50.524135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:50.525595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:50.534156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:50.599266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 166/322] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:50.622101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47d783-0ca5-4074-97e5-2d79f2e3a8d6 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:50.622265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:50.662619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:50.663334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.663622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.664027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.675868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:50.684378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:50.685217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:50.686083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 157/323] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:50.692070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:50.736829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:50.738423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4486d-187a-4b38-90cc-521fe834a91e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:50.775789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:50.776576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.776860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.777134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.778288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:50.779751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:50.781370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 167/324] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:50.787382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:50.799707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:50.816983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8186a7-766e-40f5-94b4-bcbbb55d0fde None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:50.853927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:50.854626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.855065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.855353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.856231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:50.856540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:50.857915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:50.871863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 158/325] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:50.872869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:50.895836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ce97-889f-49ef-b1fc-e6a75eab98a8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:50.930679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959b7d-ce06-4591-98f9-1ee9445b7685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:50.931272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959b7d-ce06-4591-98f9-1ee9445b7685 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.931560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959b7d-ce06-4591-98f9-1ee9445b7685 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.931840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959b7d-ce06-4591-98f9-1ee9445b7685 None admin] PATH_INFO: `/v3/groups` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.932597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be959b7d-ce06-4591-98f9-1ee9445b7685 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:50.933963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be959b7d-ce06-4591-98f9-1ee9445b7685 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:50.948801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 168/326] 10.222.0.64 () {60 vars in 1134 bytes} [Tue Jul 19 15:31:50 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:31:50.950042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871f99-8ba5-4382-acde-e6a448ccddcb None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.950350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871f99-8ba5-4382-acde-e6a448ccddcb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.950651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871f99-8ba5-4382-acde-e6a448ccddcb None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.951905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 169/327] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:50.958527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:50.958813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:50.959089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:50.976794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:50.978024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:50.993122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:50.996223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680302b8-6040-4d5d-bf8e-f6586cc9e2b6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:51.037609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:51.038708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:51.038995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:51.039282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] PATH_INFO: `/v3/users/2c3c5210a59c4368a498dd72e63759cc` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:51.040620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3c5210a59c4368a498dd72e63759cc)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:51.042108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:51.043841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 159/328] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:50 2022] GET /identity/v3/users/2c3c5210a59c4368a498dd72e63759cc => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:51.049571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:51.058249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:51.075038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 170/329] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:51.091032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:51.178087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a82e5-84d9-41dc-a3e1-04d9641d83d2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:51.222480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:51.222931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f88df-8dd7-4a13-bacf-e01ddb1d3376 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:51.223293 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:51.223626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:51.223906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] PATH_INFO: `/v3/system/users/2c3c5210a59c4368a498dd72e63759cc/roles/5f6fa9f4eb5c49329e3ac9e9e22269ad` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:51.226497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2c3c5210a59c4368a498dd72e63759cc, role_id=5f6fa9f4eb5c49329e3ac9e9e22269ad)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:51.227960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:51.239313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 160/330] 10.222.0.64 () {58 vars in 1334 bytes} [Tue Jul 19 15:31:51 2022] PUT /identity/v3/system/users/2c3c5210a59c4368a498dd72e63759cc/roles/5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:31:51.275234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:51.276481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:51.276841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:51.277196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:51.289768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:51.297965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:51.298950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:51.299710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 171/331] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:51.306896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:51.347833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:51.433629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc43d0-e21b-4660-a686-d85931bd5c9a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:51.471373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:51.472047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:51.472595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:51.473152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:51.473988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] RBAC: Adding query filter params (name=member) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:51.474296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:51.475729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:51.485861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 161/332] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:51.492495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:51.566553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:51.611036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c82c-d367-4093-bcf4-727cc53464a9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:51.651559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96387cb-a4ad-414d-81d0-80b5907508f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:51.651922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96387cb-a4ad-414d-81d0-80b5907508f4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:51.652198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96387cb-a4ad-414d-81d0-80b5907508f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:51.652481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96387cb-a4ad-414d-81d0-80b5907508f4 None admin] PATH_INFO: `/v3/users/5c9282bc2e794fa49c231c5eaea7c0ec` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:51.653729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96387cb-a4ad-414d-81d0-80b5907508f4 None admin] RBAC: Authorizing `identity:get_user(user_id=5c9282bc2e794fa49c231c5eaea7c0ec)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:51.655208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96387cb-a4ad-414d-81d0-80b5907508f4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:51.657023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 172/333] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:51 2022] GET /identity/v3/users/5c9282bc2e794fa49c231c5eaea7c0ec => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:51.664281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:51.790339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:51.802729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d232a-80a3-4deb-8cd9-c236f67190da None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:51.851218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:51.851886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:51.852178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:51.852463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:51.853311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] RBAC: Adding query filter params (role.id=7847dd8004504fe890aac6ff853967c8, user.id=5c9282bc2e794fa49c231c5eaea7c0ec, scope.system=all) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:51.853629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:51.855152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a60836-ef29-4013-8d3d-652bf8f7a732 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:51.873343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 162/334] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 19 15:31:51 2022] GET /identity/v3/role_assignments?user.id=5c9282bc2e794fa49c231c5eaea7c0ec&scope.system=all&role.id=7847dd8004504fe890aac6ff853967c8 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:53.659049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa6ab-039e-4d85-81c3-2ed5178b2cee None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:53.659751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa6ab-039e-4d85-81c3-2ed5178b2cee None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:53.659751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa6ab-039e-4d85-81c3-2ed5178b2cee None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:53.661544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 173/335] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:53.667963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:53.668477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:53.668557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:53.686390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdadbd-7517-436a-846f-44df93f2cb33 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:53.686390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdadbd-7517-436a-846f-44df93f2cb33 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:53.686390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdadbd-7517-436a-846f-44df93f2cb33 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:53.687728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 174/336] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:53.693729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:53.694323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:53.694323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:53.707903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:53.709265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:53.723752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:53.725001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:53.832092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 163/337] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:53.844416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 175/338] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:53.863123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:53.882725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:53.982853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:54.012765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:54.043725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e3da1-c6f0-475f-827e-73bd18ca7419 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.060293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a68e18-eaec-4960-a50a-4fee88b9a089 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.102190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.103131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.103424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.103703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.111572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.112386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.112674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.113074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.125186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:54.125377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:54.136526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:54.137467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:54.138259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 176/339] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:54.140413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:54.141249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:54.142574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 164/340] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:54.149619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:54.150129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:54.335232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391793-c00e-4487-a63f-6ec2ad016ae7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.341484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10aa8-565a-418a-8b41-8e9657d2c07f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.364456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:54.404383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.405064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.405356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.405631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.406409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:54.406725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:54.408106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:54.421975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.422679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.422974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.423252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.424013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:54.424323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:54.426264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:54.436263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 177/341] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:54.442834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:54.444924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 165/342] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:54.455065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:54.461942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:54.613854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431901c2-0b73-4eb9-a172-93d262102831 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.634514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889226c3-a9f9-4721-8859-6b73f4c013cd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.653754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd7b8-e5b7-48fb-8cff-d57171e5a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.654679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd7b8-e5b7-48fb-8cff-d57171e5a36c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.654965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd7b8-e5b7-48fb-8cff-d57171e5a36c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.655249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd7b8-e5b7-48fb-8cff-d57171e5a36c None admin] PATH_INFO: `/v3/users/2c3c5210a59c4368a498dd72e63759cc` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.657929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fd7b8-e5b7-48fb-8cff-d57171e5a36c None admin] RBAC: Authorizing `identity:get_user(user_id=2c3c5210a59c4368a498dd72e63759cc)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:54.659410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fd7b8-e5b7-48fb-8cff-d57171e5a36c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:54.661812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 166/343] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:31:54 2022] GET /identity/v3/users/2c3c5210a59c4368a498dd72e63759cc => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:54.664977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad411a3b-7254-4e48-90c6-ef02e5a98091 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.665267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad411a3b-7254-4e48-90c6-ef02e5a98091 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.665550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad411a3b-7254-4e48-90c6-ef02e5a98091 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.668742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 167/344] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:54.672958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad411a3b-7254-4e48-90c6-ef02e5a98091 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:54.700824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8d7a4-7fa5-465e-9220-920129a03de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.701480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8d7a4-7fa5-465e-9220-920129a03de6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.701769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8d7a4-7fa5-465e-9220-920129a03de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.702046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8d7a4-7fa5-465e-9220-920129a03de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.802774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:54.803411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:54.824574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad411a3b-7254-4e48-90c6-ef02e5a98091 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:54.847917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8d7a4-7fa5-465e-9220-920129a03de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:54.849412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8d7a4-7fa5-465e-9220-920129a03de6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:54.862836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:54.863511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.864089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.864527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.865571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] RBAC: Adding query filter params (role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad, user.id=2c3c5210a59c4368a498dd72e63759cc, scope.system=all) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:54.866036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:54.867669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9536eb-de3f-4c31-bca0-fbfc604d6b1d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:54.881224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 168/345] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 19 15:31:54 2022] GET /identity/v3/role_assignments?user.id=2c3c5210a59c4368a498dd72e63759cc&scope.system=all&role.id=5f6fa9f4eb5c49329e3ac9e9e22269ad => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:54.882981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b941-98e0-41f1-9640-10a7866936de None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.883479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b941-98e0-41f1-9640-10a7866936de None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.883951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b941-98e0-41f1-9640-10a7866936de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.902975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6081b941-98e0-41f1-9640-10a7866936de None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:54.904547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6081b941-98e0-41f1-9640-10a7866936de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:54.976726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 178/346] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:54.982601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133136df-4605-4879-a7e9-6f95892bb8d4 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:54.983670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133136df-4605-4879-a7e9-6f95892bb8d4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:54.984405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133136df-4605-4879-a7e9-6f95892bb8d4 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:54.985434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 169/347] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:54.985939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 179/348] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:54.988893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b941-98e0-41f1-9640-10a7866936de None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.002869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.003804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.004324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.029287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:55.030514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:55.077332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:55.120540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 180/349] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:31:55.121624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.138982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b941-98e0-41f1-9640-10a7866936de None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.147525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:55.189643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e77624-cbf4-46dc-98a9-12e60a7e6ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.191111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77624-cbf4-46dc-98a9-12e60a7e6ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.191566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77624-cbf4-46dc-98a9-12e60a7e6ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.192804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77624-cbf4-46dc-98a9-12e60a7e6ba5 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.194221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77624-cbf4-46dc-98a9-12e60a7e6ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:55.195855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77624-cbf4-46dc-98a9-12e60a7e6ba5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:55.198202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 170/350] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:54 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:55.199633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842d4d-3c07-4788-9896-ab6abaf70c8c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.200437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842d4d-3c07-4788-9896-ab6abaf70c8c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.200873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842d4d-3c07-4788-9896-ab6abaf70c8c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.202970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 171/351] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:55.204009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77842d4d-3c07-4788-9896-ab6abaf70c8c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.284722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67309013-e493-4b11-b14c-a652302ad0ae None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.335448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.336736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.337333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.337613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.338119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77842d4d-3c07-4788-9896-ab6abaf70c8c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.355219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:55.366306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:55.367377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:55.368190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:55.368813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 181/352] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:55.369691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.380211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:55.387762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82a464-e66e-4e49-859c-4e07167fae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.388748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82a464-e66e-4e49-859c-4e07167fae75 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.389035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82a464-e66e-4e49-859c-4e07167fae75 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.389361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82a464-e66e-4e49-859c-4e07167fae75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.403201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82a464-e66e-4e49-859c-4e07167fae75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ad82a464-e66e-4e49-859c-4e07167fae75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:55.412088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:55.413199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:55.414185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 172/353] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:55.419188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.419586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.419968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.441287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:55.443874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:55.465021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:55.512597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e88d-907d-4b42-91b9-42852f9f362f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.538381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 173/354] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:55.538381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.578381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.579377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.579667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.579944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.586799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:55.588892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:55.590214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 182/355] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:55.590856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.671332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019c41e-46e0-425a-98f8-9be3d558257f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.698028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:55.723342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.724043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.724781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.725068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.726129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:55.726488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:55.728168 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:55.731685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab253a6-fc30-4c0b-9be9-fee08d30058f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.740667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 174/356] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:55.741564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.774801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.775741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.776030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.776312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.777080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:55.777397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:55.778832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:55.780356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:55.789797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 183/357] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:55.790643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.878139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69e65-fc0d-4293-9c4f-508b7eab3ac2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.915991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.916449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d2a9-8e8d-48bf-b300-7ca8e7ba7f69 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:55.916791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.917075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.917350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.928515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:55.936074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:55.937156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:55.938226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 175/358] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:55.939160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.963839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:55.964505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:55.964797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:55.965079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:55.965923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:55.966241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:55.967767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:55.974130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 184/359] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=7847dd8004504fe890aac6ff853967c8 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:55.975952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:55.992390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.064342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.074883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bbbaa-18dc-429b-b360-5b2d1f7c92c2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.122878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406a20f-370e-44e0-ad56-bd014a3fad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.123546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a20f-370e-44e0-ad56-bd014a3fad93 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.123835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a20f-370e-44e0-ad56-bd014a3fad93 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.124117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a20f-370e-44e0-ad56-bd014a3fad93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.136638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c867a-922e-461f-9cf4-179ca4efca0e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.176214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.177050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.177437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.177727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.215362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406a20f-370e-44e0-ad56-bd014a3fad93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.217005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406a20f-370e-44e0-ad56-bd014a3fad93 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.265089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.267298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.269668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.343818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.355471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 176/360] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:56.357003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eb3f9-8812-4aa0-89f8-fbbf36e6cd88 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.357296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eb3f9-8812-4aa0-89f8-fbbf36e6cd88 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.357578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eb3f9-8812-4aa0-89f8-fbbf36e6cd88 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.359212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 177/361] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:56.360151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eb3f9-8812-4aa0-89f8-fbbf36e6cd88 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:56.397005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 185/362] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:56.398394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:56.494751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eb3f9-8812-4aa0-89f8-fbbf36e6cd88 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.520016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c80ae-0915-412b-8545-ed5d92ee5aaf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.537528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.538201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.538536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.538818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.539575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:56.539881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.541278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6dc05-cd65-479c-bb84-055a8867999e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.552384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 178/363] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:31:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:56.553749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.554109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.554877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.559790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.574692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:56.576357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:56.579627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.581847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.582174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.584578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.585280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.587252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 186/364] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:56 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:56.588032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:56.623162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.666733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 179/365] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:56.667956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:56.721156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572f3b-0a91-43b2-83cd-4ce01d2e71bb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.779036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.781799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.782086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.782405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.783638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.785744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.788677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 187/366] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:56 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:56.789495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:56.804667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bd41-3b2f-4a7a-bc00-852356acbb3b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.848441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.852900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.852900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.853131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.853347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.914162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:56.920092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a7f4a-3895-4b0a-9fbb-8b722262fd1b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:56.943501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.945569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.967143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:56.968092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:56.968379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:56.968657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:56.969834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:56.971307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:56.973883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 188/367] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:31:56 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:56.974550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.071498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 180/368] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:57.072259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.109668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:57.111236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab092-ae6b-45d5-8624-8e946eec2fd0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.153460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.154791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.155078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.155354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.171220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:57.181163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:57.182101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:31:57.182958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:31:57.184100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 189/369] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:31:57.184100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.217121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:57.224300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265337a-8b63-4071-88e3-10c88fded3e6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.273238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.274107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.275655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.275655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.276163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:57.277638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:57.279619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 181/370] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:57.280399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.315189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f8e6-80ad-4558-8397-f85fbec7c477 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.362439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.364462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.364754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.365041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.365893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:57.366211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:57.367696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:57.373803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 190/371] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:57.375291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.402707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:57.406809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f050e9-6d0f-4040-b92d-a964130736f5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.464819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.466202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.468302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.468674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.471367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:57.473191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:57.475479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 182/372] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:57.476456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.495620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:57.511532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7576e8-d3c1-4350-b36a-a0b844a39b42 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.557161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.558185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.558777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.559267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.560326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:57.560838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:57.562585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:57.579758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 191/373] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:57.580628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.628528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce317c7-68e6-45ef-8fce-67ad4332d786 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.677057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.678248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.678810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.679282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.680390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=e3a50f239f344388ad3bbaba1cac2730) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:57.681031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:57.682769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:57.691681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 183/374] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=7847dd8004504fe890aac6ff853967c8 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:57.693410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.730991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80925e-8de2-4719-ac3d-4248eeb6c180 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.739106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:57.775408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.776554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.776962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.777340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.778722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:57.780551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:57.782507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 192/375] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:57.789370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:57.830764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:57.868259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940183e8-bc82-4072-86c9-816770e41f13 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.926745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867015d9-2471-4791-9f7f-e71d09cc0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.927415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867015d9-2471-4791-9f7f-e71d09cc0750 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.927705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867015d9-2471-4791-9f7f-e71d09cc0750 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:57.927988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867015d9-2471-4791-9f7f-e71d09cc0750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:57.954209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2f57-9bf9-4b4d-933e-8dc864cf8251 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:57.998011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:57.999102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:57.999584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.000069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.001142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=e3a50f239f344388ad3bbaba1cac2730) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:58.001663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:58.005406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:58.016267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 193/376] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:58.041080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867015d9-2471-4791-9f7f-e71d09cc0750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:58.043091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867015d9-2471-4791-9f7f-e71d09cc0750 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:58.099700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:58.194809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 184/377] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:58.200407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:58.302050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:58.333583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f98c7-47f0-41e0-b103-d3627187add0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:58.383104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43107d-64be-42a2-a938-3a0d1b504511 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:58.383921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43107d-64be-42a2-a938-3a0d1b504511 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.384438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43107d-64be-42a2-a938-3a0d1b504511 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.385074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:58.385954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:58.386244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.386550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] PATH_INFO: `/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.387231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 185/378] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:31:58.390413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] RBAC: Authorizing `identity:get_project(project_id=6a28683ac9174fb4a8e11a5ac75df07c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:58.390413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:58.391199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 194/379] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:58 2022] GET /identity/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:58.392654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:58.392946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.393234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.396585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:58.427424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:58.428644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:58.501191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 186/380] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:58.536383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:58.548048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019dd6b-05ad-4731-bb79-8eaf97749439 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:58.608780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:58.609640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:58.609926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.610211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] PATH_INFO: `/v3/groups/00e3108114854a3ca6c3e9b08a133772` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.620147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] RBAC: Authorizing `identity:get_group(group_id=00e3108114854a3ca6c3e9b08a133772)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:58.621602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:58.625892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 195/381] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:31:58 2022] GET /identity/v3/groups/00e3108114854a3ca6c3e9b08a133772 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:58.630528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:58.653065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:58.653656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:58.722695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900259a-1e66-4441-9d48-213eee25e49f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:58.771119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:58.771741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:58.771843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.772069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.799307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:31:58.816036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:31:58.818114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:31:58.820057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 187/382] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:31:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:31:58.821679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6f3b0-d21f-467a-b990-b8f281b93223 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:58.827966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:58.868281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:58.868945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:58.869236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:58.869520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:58.870391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] RBAC: Adding query filter params (group.id=00e3108114854a3ca6c3e9b08a133772, role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=6a28683ac9174fb4a8e11a5ac75df07c) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:58.873106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:58.874587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:58.889569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 196/383] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:31:58 2022] GET /identity/v3/role_assignments?group.id=00e3108114854a3ca6c3e9b08a133772&scope.project.id=6a28683ac9174fb4a8e11a5ac75df07c&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:58.978721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728adf3-61cf-46b9-a815-f05e93303c88 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:59.005878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:59.025273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:59.025958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:59.026256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:59.026567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:59.027397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] RBAC: Adding query filter params (name=member) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:31:59.027720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:59.029127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:59.039230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 188/384] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:31:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:31:59.044792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:59.136326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:59.162180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e758b4-2644-483b-a857-e104fa132c9a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:59.202860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:59.203786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:59.204075 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:59.204359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:59.205615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:59.207369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:59.209004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 197/385] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:31:59 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:59.214783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:59.329920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece041f-adfb-4871-b382-9ead507a43ff None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:59.372177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18360e9-895d-414f-a5c0-553f0350a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:59.373068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18360e9-895d-414f-a5c0-553f0350a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:59.373354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18360e9-895d-414f-a5c0-553f0350a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:59.373635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18360e9-895d-414f-a5c0-553f0350a7b9 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:59.374875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18360e9-895d-414f-a5c0-553f0350a7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:59.376328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18360e9-895d-414f-a5c0-553f0350a7b9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:59.380213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 189/386] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:31:59 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:31:59.384996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:59.549914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806e95-9efa-45e4-85c4-018cc20c692e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:59.608300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d28ec-49e7-4c5a-864a-15b09ceba9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:59.609549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d28ec-49e7-4c5a-864a-15b09ceba9ab None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:59.610042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d28ec-49e7-4c5a-864a-15b09ceba9ab None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:59.610618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d28ec-49e7-4c5a-864a-15b09ceba9ab None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:59.613422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d28ec-49e7-4c5a-864a-15b09ceba9ab None admin] RBAC: Authorizing `identity:create_grant(project_id=9b71184c3b784a6c8662c36cc6a4f873, group_id=3ee2a079ce5b48a9a71ee2d4466a60b1, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:59.615215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d28ec-49e7-4c5a-864a-15b09ceba9ab None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:59.637228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 198/387] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 19 15:31:59 2022] PUT /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:00.067651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217fcf-d7c5-40e9-985c-42aac1984e08 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.068125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217fcf-d7c5-40e9-985c-42aac1984e08 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.068125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217fcf-d7c5-40e9-985c-42aac1984e08 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.069919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 190/388] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:00.075097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.075912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.076403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.094378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:00.098440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9dd47-c250-4450-a361-5dcdd3140308 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.098768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9dd47-c250-4450-a361-5dcdd3140308 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.099057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9dd47-c250-4450-a361-5dcdd3140308 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.100724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 191/389] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:00.101405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:00.105899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.106014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:00.106550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.107184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.142216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:00.145608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:00.214031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 199/390] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:00.231166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:00.243658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.276787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 192/391] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:00.316613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.424516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebbd27-a86b-41bc-813a-5be7814f5da4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:00.427115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08a7b-f04f-4043-83f4-1ced4f85c16b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:00.466220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:00.467408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.468063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.468551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.471170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c5933-650f-435f-b8c6-ee2377be6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:00.472233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5933-650f-435f-b8c6-ee2377be6821 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.472518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5933-650f-435f-b8c6-ee2377be6821 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.472837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5933-650f-435f-b8c6-ee2377be6821 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.476152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:00.482939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:00.485577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c5933-650f-435f-b8c6-ee2377be6821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:00.492834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:00.493717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:32:00.494536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b24c5933-650f-435f-b8c6-ee2377be6821 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:00.495165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:00.496026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:00.497667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:00.500544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 200/392] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:00.501131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 193/393] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:00.501828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a68689-a016-4538-b665-589ca7a58c39 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.503012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a68689-a016-4538-b665-589ca7a58c39 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.503012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a68689-a016-4538-b665-589ca7a58c39 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.503963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.507877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 201/394] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:00.509350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.509641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.509923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.528861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:00.530061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:00.560506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:00.613627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 202/395] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:00.614539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.629906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c065d-56ac-4134-a61d-8d0c94c7a01d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:00.668787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:00.669728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.670211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.670631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.671592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:00.672027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:00.673621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:00.683690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 194/396] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:00.684738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.738270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb71d6-5881-4a6f-9cf5-303b153ed570 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:00.770842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:00.782193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:00.783056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.783349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.783632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.785369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:00.785693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:00.789069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:00.799911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 203/397] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:00.802420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.806586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b0b5-32cf-43d5-b99a-644516ea29bd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:00.810803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:00.854555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:00.856013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.856545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.857198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.873386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:00.885733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:00.886678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:00.887488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:00.890283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 195/398] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:00.891739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:00.920221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cdcf6-314c-4d2d-9a30-850e9564842b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:00.962008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:00.962925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:00.963396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:00.963717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:00.965117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:00.966709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:00.968724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 204/399] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:00.969979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.007830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d4946-5254-437f-bf01-41c87b200dcf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.033655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.048357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.049676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.050852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.051530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.053068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.054777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.056652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 196/400] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:01.057735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.086516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b2779-cee4-4084-bb23-f45b2a7d98b8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.092781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.128992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.129962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.130416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.130942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.131943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:01.132496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.134083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.144555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 205/401] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:01.146868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.167775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788169fd-a184-4b14-9811-2d5ba9789ae9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.203465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.204572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.205010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.205438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.207388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.208981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.211391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 197/402] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:01 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:01.212380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.259338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c086-b7ee-4035-85b8-a2e6b3fbd33c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.282710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.298072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.299113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.299498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.299879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.302477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.304117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.311213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 206/403] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:01 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:01.312202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.319233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.322487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02fa3-329d-4713-9eb2-a1002d203978 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.359042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.360135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.360571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.361024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.362460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.364299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.366514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 198/404] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:01 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:01.367457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.443442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe9ce8-0062-4c53-b90b-a2b23a544264 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.477903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b0b01-e40e-4784-98b3-0f2a83b96d59 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.485005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.486255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.486388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.486606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.489601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b71184c3b784a6c8662c36cc6a4f873, group_id=3ee2a079ce5b48a9a71ee2d4466a60b1, role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.491298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.510409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 207/405] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 19 15:32:01 2022] PUT /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/04c92931c9c541f9af08fe6b22629f71 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:01.511507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.519682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c374a4-eb98-461e-8fad-2e6cdd2ee762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.521384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c374a4-eb98-461e-8fad-2e6cdd2ee762 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.521984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c374a4-eb98-461e-8fad-2e6cdd2ee762 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.522624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c374a4-eb98-461e-8fad-2e6cdd2ee762 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.526216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c374a4-eb98-461e-8fad-2e6cdd2ee762 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a50f239f344388ad3bbaba1cac2730, group_id=3ee2a079ce5b48a9a71ee2d4466a60b1, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.528190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c374a4-eb98-461e-8fad-2e6cdd2ee762 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.574272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 199/406] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 19 15:32:01 2022] PUT /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:01.590569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294bfbc-b862-431b-b16d-4270ff276417 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.591197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294bfbc-b862-431b-b16d-4270ff276417 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.591686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294bfbc-b862-431b-b16d-4270ff276417 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.593583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 200/407] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:01.600543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.601195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.601683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.614640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.633249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:01.636093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:01.686745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.710676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549fae-b572-4e33-97c1-78e1d7e64232 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.760007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 201/408] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:01.773044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.773945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.774235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.774549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.776072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.777542 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.779405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 208/409] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:01 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:01.786300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.789212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:01.913991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d4b7-c9a6-4808-83fc-d949da9d83f1 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.940703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcf20c-e340-4d8e-bb43-bb41a87c6f3b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:01.951318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:01.952515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:01.953015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:01.953490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:01.961031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a50f239f344388ad3bbaba1cac2730, group_id=3ee2a079ce5b48a9a71ee2d4466a60b1, role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:01.962805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:01.968887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.985170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 202/410] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 19 15:32:01 2022] PUT /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730/groups/3ee2a079ce5b48a9a71ee2d4466a60b1/roles/04c92931c9c541f9af08fe6b22629f71 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:02.001145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486276d-f348-426b-82ab-56835eba92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.002002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486276d-f348-426b-82ab-56835eba92b5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.002297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486276d-f348-426b-82ab-56835eba92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.002654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486276d-f348-426b-82ab-56835eba92b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.018376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486276d-f348-426b-82ab-56835eba92b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9486276d-f348-426b-82ab-56835eba92b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:02.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:02.029194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:02.029980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 209/411] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:02.037589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.067630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:02.073941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652ea5-3b63-4645-8299-b017fbbf727f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.074248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652ea5-3b63-4645-8299-b017fbbf727f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.074535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652ea5-3b63-4645-8299-b017fbbf727f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.076302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 210/412] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:02.089970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.090748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.090748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.124871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:02.126122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:02.204135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928209a-451e-46fe-91b8-7470b80c58fc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:02.227894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 211/413] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:02.249411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.250104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.254263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.254263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.254263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:02.254263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:02.254263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:02.258002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.269801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 203/414] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:02.275980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.415702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:02.435669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed9a89-9aeb-4442-b3c6-d1bd20f8f8b8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:02.439907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:02.455250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89247b83-6657-444e-b159-3b1d0372c3c2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:02.498115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.498960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.499249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.499531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.518189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.519762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.520110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.520438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] PATH_INFO: `/v3/groups/00e3108114854a3ca6c3e9b08a133772` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.521659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] RBAC: Authorizing `identity:get_group(group_id=00e3108114854a3ca6c3e9b08a133772)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:02.524748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:02.527667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:02.532847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 204/415] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:02 2022] GET /identity/v3/groups/00e3108114854a3ca6c3e9b08a133772 => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:02.533689 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:02.539994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:02.540901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:32:02.541694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:02.547291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 212/416] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:02.555102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.708645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a50bb-5f0f-44c2-ae65-bd83fc007ce2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:02.744482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06653d-8936-4577-baaf-1710a3cdcde4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:02.752146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.753020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.753394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.753962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] PATH_INFO: `/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.755385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] RBAC: Authorizing `identity:get_project(project_id=6a28683ac9174fb4a8e11a5ac75df07c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:02.757435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:02.759436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 205/417] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:02 2022] GET /identity/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:02.765305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.790944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:02.847742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.848445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.848741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.849024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:02.849792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:02.850106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:02.856906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:02.866701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 213/418] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:32:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:02.874536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:02.922110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4771c-5aa1-4cf4-b2e9-6b6dedc0170e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:02.926078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:02.994478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:02.995739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:02.996457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:02.996936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] PATH_INFO: `/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c/groups/00e3108114854a3ca6c3e9b08a133772/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:03.001667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a28683ac9174fb4a8e11a5ac75df07c, group_id=00e3108114854a3ca6c3e9b08a133772, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:03.005103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:03.027628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 206/419] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 19 15:32:02 2022] PUT /identity/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c/groups/00e3108114854a3ca6c3e9b08a133772/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:03.080038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdcd81-2efc-4bb6-8c94-4e556db8b3d2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:03.127468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:03.129855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:03.130332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:03.130815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:03.224293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:03.226038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:03.255138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:03.343494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 214/420] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:03.349932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:03.455976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:03.494130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4f5b-b963-4885-ac35-0f9deba94ff2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:03.531503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:03.532708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:03.533180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:03.533642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:03.535554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:03.537180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:03.539431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 207/421] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:03 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:03.545284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:03.673359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09b55-d733-497f-8910-0a03b478e6ea None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:03.715976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:03.728665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d699b94-bc0e-4d85-936f-2615ac047fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:03.729534 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699b94-bc0e-4d85-936f-2615ac047fef None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:03.729823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699b94-bc0e-4d85-936f-2615ac047fef None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:03.730106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699b94-bc0e-4d85-936f-2615ac047fef None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:03.735069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d699b94-bc0e-4d85-936f-2615ac047fef None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:03.736513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d699b94-bc0e-4d85-936f-2615ac047fef None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:03.738561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 215/422] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:03 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:03.744254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:03.905604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72778769-8956-4a02-b061-82740b34ea69 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:03.954163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:03.955192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:03.955681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:03.956207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:03.957537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:03.958075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:03.959794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341edc76-841e-4cf6-985e-2b111b61b75a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:03.966604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 208/423] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:32:03 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=7847dd8004504fe890aac6ff853967c8 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:04.095688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcd60f-6dd2-4bf1-a36c-fee41c0c7d53 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.098418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcd60f-6dd2-4bf1-a36c-fee41c0c7d53 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.098418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcd60f-6dd2-4bf1-a36c-fee41c0c7d53 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.098963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 216/424] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:04.104264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d31d0c-2484-428a-a13d-a18dc122f34b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.104859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d31d0c-2484-428a-a13d-a18dc122f34b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.105342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d31d0c-2484-428a-a13d-a18dc122f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.127989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-89d31d0c-2484-428a-a13d-a18dc122f34b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:04.130025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-89d31d0c-2484-428a-a13d-a18dc122f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:04.136855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:04.220080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 209/425] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:04.251317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcd60f-6dd2-4bf1-a36c-fee41c0c7d53 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:04.263591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329742d-58de-4e10-aba5-03717574d5eb None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.264194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329742d-58de-4e10-aba5-03717574d5eb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.264729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329742d-58de-4e10-aba5-03717574d5eb None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.266690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 210/426] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:04.273624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.274175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.274760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.305945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:04.307713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:04.377058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcd60f-6dd2-4bf1-a36c-fee41c0c7d53 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:04.392996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 211/427] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:04.413637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:04.414503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.414794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.415079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.421559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:04.426728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:04.434869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:04.435794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:04.436613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 217/428] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:04.443135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:04.510406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:04.515964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:04.555798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2dd27-7611-406b-b4ea-807d5b6a818b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:04.571831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fd642-2600-41de-a644-e88c0d09d68e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:04.596454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:04.598005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.598651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.598941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.610837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:04.611022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:04.611515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.611805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.612085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.613419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:04.613735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:04.615155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eb782-cba6-4a25-8746-d8b1e280cc0a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:04.621021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:04.621899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:32:04.622831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:04.625608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 218/429] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:04.625792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f5a8-5cb8-47b8-942d-3fca108b0dc6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.626035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f5a8-5cb8-47b8-942d-3fca108b0dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.626190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 212/430] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:04.626329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f5a8-5cb8-47b8-942d-3fca108b0dc6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.627940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 219/431] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:04.633032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:04.633591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f5a8-5cb8-47b8-942d-3fca108b0dc6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:04.768966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f5a8-5cb8-47b8-942d-3fca108b0dc6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:04.778310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4ebb3-a182-44ba-8438-225271a15d63 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:04.792227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:04.809037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:04.813712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:04.814698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.815002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.815258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.816828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:04.817142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:04.819438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196f512-b7fc-478d-88af-ae3f286cc3e2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:04.820348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:04.820348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.820950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.821507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.832908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 220/432] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:04.832908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:04.832908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:04.832908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:04.848467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:04.849656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:04.894859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:04.896340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:04.921807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 221/433] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:04.923027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.007138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 213/434] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:05.007998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.038508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.045623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718cdf9-9104-4e5b-b740-d03bbf80d4df None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.055817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.084604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.085363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.085653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.085930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.117608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda2e7-413d-4aa4-91f5-f398cc6157b1 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.154753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.155579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.155865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.156149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.158205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.161028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.168790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:05.177498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:05.178401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:05.179252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 214/435] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:05.180186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.275897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.286098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 222/436] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:05.287502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.293787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0a88e-7d80-43ea-bbec-a394bae8fc52 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.300223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.328493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.329353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.329643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.329926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] PATH_INFO: `/v3/projects/9b71184c3b784a6c8662c36cc6a4f873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.331187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9b71184c3b784a6c8662c36cc6a4f873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.333552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.335426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 215/437] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/projects/9b71184c3b784a6c8662c36cc6a4f873 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:05.340312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.396961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64059509-c440-4127-958f-509262f6d7e8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.433704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.434397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.434692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.434973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.435731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:05.436032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.437443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.446286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 223/438] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:05.447113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.453993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201753b-cdb2-4f1a-b98d-a5f56699a7f6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.492020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.493264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.493747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.494195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.495573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.497323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.499329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 216/439] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:05.500341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.520546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.527859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.553019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa823b-25b7-434c-ae90-4cd284afbc0f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.587422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b18e6-8242-411f-a485-c7aec211220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.588268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b18e6-8242-411f-a485-c7aec211220f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.588548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b18e6-8242-411f-a485-c7aec211220f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.588821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b18e6-8242-411f-a485-c7aec211220f None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.589984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b18e6-8242-411f-a485-c7aec211220f None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.591455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b18e6-8242-411f-a485-c7aec211220f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.593046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 224/440] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:05.594193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cfa47-78f8-483a-ae8a-42019f7da3c3 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.594510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cfa47-78f8-483a-ae8a-42019f7da3c3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.594789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cfa47-78f8-483a-ae8a-42019f7da3c3 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.595998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 225/441] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:05.596676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cfa47-78f8-483a-ae8a-42019f7da3c3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.608580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5a334-6f83-4e39-a92b-34a6b9cd64b5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.642571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea384c6-323b-4738-bd89-386921d749d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.643235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea384c6-323b-4738-bd89-386921d749d3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.643508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea384c6-323b-4738-bd89-386921d749d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.644484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea384c6-323b-4738-bd89-386921d749d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.699409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cfa47-78f8-483a-ae8a-42019f7da3c3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.712611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea384c6-323b-4738-bd89-386921d749d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.714098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea384c6-323b-4738-bd89-386921d749d3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.732824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.733675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.733959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.734240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.735437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.736897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.738496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.739080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 226/442] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:05.739847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.748193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.817591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 217/443] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:05.819134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.819431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.819714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.836247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:05.837426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:05.842873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f3503-5a81-4151-bbf4-7bbc6a392b37 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:05.876344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:05.877002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:05.877285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:05.877561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:05.879022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=9b71184c3b784a6c8662c36cc6a4f873) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:05.879339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:05.880752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:05.886496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 227/444] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=9b71184c3b784a6c8662c36cc6a4f873&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:05.887272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.905302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 218/445] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:05.906178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:05.965199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:05.985938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:06.002688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef686b9-e923-411f-b52f-bbe294a99c94 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.036774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc11463-8c7d-43cb-af9f-a5905b7aa448 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.043293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.044018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.044311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.044661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.045637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=7847dd8004504fe890aac6ff853967c8, scope.project.id=e3a50f239f344388ad3bbaba1cac2730) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:06.045958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.047660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.055675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 228/446] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=7847dd8004504fe890aac6ff853967c8 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:06.056261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:06.095737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.096633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.097012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.097306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] PATH_INFO: `/v3/projects/e3a50f239f344388ad3bbaba1cac2730` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.099669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a50f239f344388ad3bbaba1cac2730)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.101157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.103167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 219/447] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:05 2022] GET /identity/v3/projects/e3a50f239f344388ad3bbaba1cac2730 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:06.109292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:06.211442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa68375-8573-4c70-9f96-6413db4f145b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.249462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05cfdb-0889-4125-af4c-021bd985aae8 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.255921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.256734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.257023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.257304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.260271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:06.276995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:06.279697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:06.287783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:06.289018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:06.289805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 229/448] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:06.294833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:06.296132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.297005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.297294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.297578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] PATH_INFO: `/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.298841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] RBAC: Authorizing `identity:get_group(group_id=3ee2a079ce5b48a9a71ee2d4466a60b1)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.300931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.302613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 220/449] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/groups/3ee2a079ce5b48a9a71ee2d4466a60b1 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:06.308517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:06.421277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d5d9-ede8-483d-90c1-51c72fdcb30a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.438778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a88c35-17cf-493d-b86a-d5e032988e9a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.461140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.461826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.462111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.462424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.463176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:06.463487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.464872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.474692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 230/450] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:06.480217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:06.481900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.482619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.482902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.483186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.485050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] RBAC: Adding query filter params (group.id=3ee2a079ce5b48a9a71ee2d4466a60b1, role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=e3a50f239f344388ad3bbaba1cac2730) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:06.485369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.486957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.494686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 221/451] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/role_assignments?group.id=3ee2a079ce5b48a9a71ee2d4466a60b1&scope.project.id=e3a50f239f344388ad3bbaba1cac2730&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:06.545470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:06.592575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c333ccd-be63-4559-ba55-f6036bbf9ac6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.627497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.628868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.629161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.629440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.701301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.702805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.757774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:06.804235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 231/452] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:06.810062 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:06.867020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:06.911491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a63d96-d14b-44bb-879a-ef3e4ff8ef70 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:06.943349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:06.944132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:06.944415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:06.944692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] PATH_INFO: `/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:06.945857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] RBAC: Authorizing `identity:get_project(project_id=6a28683ac9174fb4a8e11a5ac75df07c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:06.947321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:06.948988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 222/453] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/projects/6a28683ac9174fb4a8e11a5ac75df07c => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:06.954582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:07.052686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a08e-d009-4051-bc37-8704cba243e1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:07.085406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8b93-5c69-45b7-8c62-8b5b49600804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:07.086261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8b93-5c69-45b7-8c62-8b5b49600804 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:07.086573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8b93-5c69-45b7-8c62-8b5b49600804 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:07.086854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8b93-5c69-45b7-8c62-8b5b49600804 None admin] PATH_INFO: `/v3/groups/00e3108114854a3ca6c3e9b08a133772` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:07.088043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8b93-5c69-45b7-8c62-8b5b49600804 None admin] RBAC: Authorizing `identity:get_group(group_id=00e3108114854a3ca6c3e9b08a133772)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:07.089489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8b93-5c69-45b7-8c62-8b5b49600804 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:07.091135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 232/454] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 19 15:32:06 2022] GET /identity/v3/groups/00e3108114854a3ca6c3e9b08a133772 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:07.097025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:07.193905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf0e3a-7dbc-4f88-96ab-da36ecb206a7 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:07.216040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:07.228521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:07.229171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:07.229460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:07.229742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:07.230603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] RBAC: Adding query filter params (group.id=00e3108114854a3ca6c3e9b08a133772, role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=6a28683ac9174fb4a8e11a5ac75df07c) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:07.230922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:07.232359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d88c-f3f5-4bac-90ad-fa6c0eca8575 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:07.238048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 223/455] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 19 15:32:07 2022] GET /identity/v3/role_assignments?group.id=00e3108114854a3ca6c3e9b08a133772&scope.project.id=6a28683ac9174fb4a8e11a5ac75df07c&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:09.642342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15627c1-6140-4e8f-9280-9c74cc394973 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:09.643405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15627c1-6140-4e8f-9280-9c74cc394973 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:09.644017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15627c1-6140-4e8f-9280-9c74cc394973 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:09.646151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 233/456] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:09.653818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:09.654703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:09.655191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:09.692120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:09.693351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:09.798785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 224/457] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:09.843912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15627c1-6140-4e8f-9280-9c74cc394973 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:09.874808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:09.985187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15627c1-6140-4e8f-9280-9c74cc394973 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:10.025783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:10.026602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.026885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.027159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.038065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:10.039611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:10.060006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:10.060901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:10.061741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:10.061741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:10.061741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:10.061741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:10.064036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 234/458] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:10.069720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:10.224399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982431f-de30-48c5-9ea4-f156ae437dfb None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:10.249921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:10.275580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:10.276517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.276927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.277324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.278417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:10.278869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:10.280873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714c16-7753-41d1-80ca-5c1b15091048 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:10.305963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 225/459] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:10.311521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:10.392664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377656-1519-4a79-9784-6d6fd1902582 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.393070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377656-1519-4a79-9784-6d6fd1902582 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.393645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377656-1519-4a79-9784-6d6fd1902582 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.396478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 226/460] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:10.408573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13795f-aee0-44cf-beae-13b58779ab73 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.409183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13795f-aee0-44cf-beae-13b58779ab73 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.409861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13795f-aee0-44cf-beae-13b58779ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.430747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:10.450150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5f13795f-aee0-44cf-beae-13b58779ab73 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:10.451606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5f13795f-aee0-44cf-beae-13b58779ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:10.452667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66ed1-2f9a-446d-a119-f4a599022280 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:10.490019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb11327-888d-42d5-affd-5ca76af1c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:10.490723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11327-888d-42d5-affd-5ca76af1c013 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.491022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11327-888d-42d5-affd-5ca76af1c013 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.491300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11327-888d-42d5-affd-5ca76af1c013 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.492024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb11327-888d-42d5-affd-5ca76af1c013 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:10.493480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb11327-888d-42d5-affd-5ca76af1c013 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:10.521050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 235/461] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:32:10 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:10.524255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73db00-2082-49b6-b2d1-cead43fff477 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.525337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73db00-2082-49b6-b2d1-cead43fff477 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.526255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73db00-2082-49b6-b2d1-cead43fff477 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.533233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 236/462] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:10.533233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070d74-8990-4e27-a868-39bac549e35f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.533233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070d74-8990-4e27-a868-39bac549e35f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.533233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070d74-8990-4e27-a868-39bac549e35f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.538557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 237/463] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:10.540712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.541426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.541921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.551524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 227/464] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:10.553055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.553350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.553641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.563923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:10.566712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:10.579737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:10.581071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:10.671141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 228/465] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:10.678497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:10.678797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 238/466] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:10.704281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:10.724829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:10.778935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:10.802561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f212c8-e3a6-4bca-904a-67747098b2ea None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:10.826518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f23437-1c73-4796-b123-502d90d6a266 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:10.849612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:10.850731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.851015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.851294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.864045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:10.865107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:10.865535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:10.865962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:10.866276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:10.868985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:10.878922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:10.880594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:10.891208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:10.892255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:10.893205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:10.893205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:10.893205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:10.893205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:10.893205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 229/467] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:10.894042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:10.902261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:10.903307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:10.904214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:10.904214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:10.904214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:10.904214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:10.906007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 239/468] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:10.906964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.017343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:11.030231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3dc01-9061-4810-bf0d-98414b39ecd4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.031590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec642ad3-4f22-4aa0-8262-ae911eb7fd63 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.046380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:11.067851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.068820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.069251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.069735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.070640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:11.071093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.072605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.075989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.076781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.077065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.077344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.091344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.092798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.093578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 240/469] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:11.094676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:11.124226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:11.125147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:11.126004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:11.126004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:11.126004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:11.126004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:11.126004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 230/470] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:11.126850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.214083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c4b49-df99-49f9-86ea-ad46abbbd3c2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.256406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed5bbb-5183-4345-8767-115c2ba3c3cf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.260538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.261204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.261491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.261770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.262536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:11.262848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.264254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.279697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 241/471] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:11.280862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.304514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.305638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.306125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.306629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.307543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.309184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.322106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:11.327379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:11.339317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 231/472] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:32:11 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:11.340600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.456591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4c374-b1b9-467e-9f41-6730ae5aaee2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.478496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d7b8b-30f9-41b3-af67-65f1e2c4ad57 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.504543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.505741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.506610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.507364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.508461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:11.509296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.511346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cdd5e-7541-4de9-ad75-b24c0f146b7a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.517500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed952310-dc1d-481b-8df5-30568585af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.518171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed952310-dc1d-481b-8df5-30568585af27 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.518536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed952310-dc1d-481b-8df5-30568585af27 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.519403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed952310-dc1d-481b-8df5-30568585af27 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.520175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed952310-dc1d-481b-8df5-30568585af27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.521632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed952310-dc1d-481b-8df5-30568585af27 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.529144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 242/473] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:11.531798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee65710-a07a-4ea4-8518-17f0dbc5c140 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.532715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee65710-a07a-4ea4-8518-17f0dbc5c140 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.533396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee65710-a07a-4ea4-8518-17f0dbc5c140 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.535580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 243/474] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:11.536576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee65710-a07a-4ea4-8518-17f0dbc5c140 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.550443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 232/475] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:32:11 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:11.550443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.550443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.550443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.574333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:11.575873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:11.668404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:11.701772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:11.717219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee65710-a07a-4ea4-8518-17f0dbc5c140 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.725856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 233/476] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:11.749555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:11.770394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.771070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.771353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.771630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.772393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.773961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.797018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 244/477] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:32:11 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:11.872214 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0e56-9bd3-4c55-958b-f47070cca17b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:11.916725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:11.920236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:11.922665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:11.925961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:11.933463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:11.943084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:11.953112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.sql.core [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 15:32:11.953112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 15:32:11.953112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [parameters: {'id': '6dbe52a4821d444c96e2815d08691413', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 15:32:11.953112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86832) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result.read() Jul 19 15:32:11.973922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:32:11.974890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application yield resource Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise self.value Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application session.commit() Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 15:32:11.976254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.session.flush() Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application compat.raise_( Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 15:32:11.977501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:32:11.979037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result.read() Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:32:11.981806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [parameters: {'id': '6dbe52a4821d444c96e2815d08691413', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:11.985916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 15:32:11.988546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:11.995073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 234/478] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 19 15:32:11 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:11.995169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.129761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e59a-f57a-45fd-8c03-3941c8e10ffc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.190394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9f5c-dd5f-47a4-aeee-01aac8fa116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.190394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9f5c-dd5f-47a4-aeee-01aac8fa116e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.191329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9f5c-dd5f-47a4-aeee-01aac8fa116e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.191423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9f5c-dd5f-47a4-aeee-01aac8fa116e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.203532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9f5c-dd5f-47a4-aeee-01aac8fa116e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e4ba9f5c-dd5f-47a4-aeee-01aac8fa116e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:12.212998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:12.214066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:12.215292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 245/479] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:12.220301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.282805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:12.351192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969752d9-ec6d-45c7-a328-85ea1ff2f1dc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.423769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.426777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.427076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.427357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.428140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:12.428448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.429917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527acc3f-2e29-4fc6-b0fd-54d3ccd9c96b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.457910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 235/480] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.218612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57272b1-67b1-4193-8d09-1f4468cfb8ca None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.219103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57272b1-67b1-4193-8d09-1f4468cfb8ca None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.219177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57272b1-67b1-4193-8d09-1f4468cfb8ca None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.220684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 246/481] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:13.226979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.226979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.226979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.259780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:13.261505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:13.387908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 236/482] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:13.432335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57272b1-67b1-4193-8d09-1f4468cfb8ca None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.451800 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.595613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57272b1-67b1-4193-8d09-1f4468cfb8ca None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.640942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.641749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.642032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.642307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.668423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:13.676727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:13.677645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:13.678479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:13.688114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 247/483] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:13.696578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.798742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.944408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e142d-45e1-42a2-86b5-9249ebb81ad0 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.019727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.020405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.020692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.020971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.021715 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:14.022027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.023607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.041641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 237/484] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:14.047260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.170810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.196371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe262fe-3b1e-4721-a8ed-417293273600 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.231023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.231895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.232199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.232478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.243866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.245313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-31d3a961-c6f6-487b-9b0f-7b98f28daa98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:14.263805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:14.264690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:14.265527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:14.265527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:14.265527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:14.265527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:14.265527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 248/485] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:14.273997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.380096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.383895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a35e7-fc56-4c22-b115-ee8f821141bc None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.384303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a35e7-fc56-4c22-b115-ee8f821141bc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.384684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a35e7-fc56-4c22-b115-ee8f821141bc None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.386175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 249/486] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:14.387086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399df5d-c97c-4ae9-b631-5a7c2155e17f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.392040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77488c7-9205-4207-985b-50f56939576b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.392490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77488c7-9205-4207-985b-50f56939576b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.392868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77488c7-9205-4207-985b-50f56939576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.424539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f77488c7-9205-4207-985b-50f56939576b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:14.427420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f77488c7-9205-4207-985b-50f56939576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.498633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.498633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.498633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.498633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.499029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:14.499029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.499029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b20f7-4e91-41d7-9287-0e62a83cd12c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.527173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 238/487] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:14.528815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9926-dde2-443e-ab8b-bceb6bff65d2 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.529450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9926-dde2-443e-ab8b-bceb6bff65d2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.530678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9926-dde2-443e-ab8b-bceb6bff65d2 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.538389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 239/488] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:14.539455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9926-dde2-443e-ab8b-bceb6bff65d2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.577376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 250/489] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:14.580569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.582679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.583185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.616591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:14.618827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.718290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.753602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9926-dde2-443e-ab8b-bceb6bff65d2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.758401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 251/490] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:14.758401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.822990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.825775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.826419 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.827412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.840904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.847617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:14.869234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:14.870170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:14.871178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:14.873453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 240/491] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:14.883429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.908744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.955196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644e0a-f00f-4653-9cba-09264a74ea92 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.006468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.006468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.006468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.006468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.019433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:15.034711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:15.035629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 252/492] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:15.036889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.056558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed592b4-018b-45c6-b08c-5e1a69924960 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.096736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.105357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b379-e391-4abc-b508-423c5b684620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.106932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b379-e391-4abc-b508-423c5b684620 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.107595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b379-e391-4abc-b508-423c5b684620 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.108084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b379-e391-4abc-b508-423c5b684620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.120261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b379-e391-4abc-b508-423c5b684620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-6b14b379-e391-4abc-b508-423c5b684620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:15.129937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:15.130896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:15.131834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:15.134602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 241/493] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:15.136217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46241bc-42ca-451d-b4fa-46ff7ffddf09 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.136700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46241bc-42ca-451d-b4fa-46ff7ffddf09 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.137186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46241bc-42ca-451d-b4fa-46ff7ffddf09 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.139326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 242/494] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:15.140332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46241bc-42ca-451d-b4fa-46ff7ffddf09 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.170565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0096-c696-4021-8e5f-27d94e22a997 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.209928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.210767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.211053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.211333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.212190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:15.212582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.213942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.242249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.256580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 253/495] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:15.257525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.274803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46241bc-42ca-451d-b4fa-46ff7ffddf09 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.317476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.318294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.318683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.319194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.319966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:15.320279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.321716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012488df-b55b-4762-831b-2444fb4e4565 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.332005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 243/496] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:15.333481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.333776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.334055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.359183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.360399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.398325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.402295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2eb2-0c5e-4a45-90a4-e951d882b6c1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.447854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.448686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.449047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.449508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.450426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:15.450808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.452420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.466044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 244/497] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:15.467092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.490239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 254/498] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:15.490239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.564492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.601417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765030c-a468-4cc8-99bf-db6f335520c6 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.619300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82216-605f-43e4-8b9c-d63105bdb760 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.636721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.637376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.637665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.638059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.657853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.658877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.659933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.660293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.672337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.673815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:15.692659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:15.693670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:15.694746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:15.694746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:15.694746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:15.694746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:15.694746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 255/499] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:15.696113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.713447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.728767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.730541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.808919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214cbe-bf05-4a33-abd1-237aae683d4a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.812971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.847865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bf6d5-82dd-4e37-8cd8-b29085ee25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.848739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bf6d5-82dd-4e37-8cd8-b29085ee25e0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.849023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bf6d5-82dd-4e37-8cd8-b29085ee25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.849545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bf6d5-82dd-4e37-8cd8-b29085ee25e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.849648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 245/500] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:15.850192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.861505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bf6d5-82dd-4e37-8cd8-b29085ee25e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f27bf6d5-82dd-4e37-8cd8-b29085ee25e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:15.873597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:15.874586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:15.875374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 256/501] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:15.876595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192d16-4830-4099-951c-fabc48b602d7 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.876887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192d16-4830-4099-951c-fabc48b602d7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.877168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192d16-4830-4099-951c-fabc48b602d7 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.882514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 257/502] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:15.883364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192d16-4830-4099-951c-fabc48b602d7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.968771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf84d4-00fa-4303-901c-1ee7b5fb26ce None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.969986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.998993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192d16-4830-4099-951c-fabc48b602d7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.008169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.008969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.009254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.009968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.021049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.022546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.036446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.037250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.037400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.037667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.038428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:16.038741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.040117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:16.042545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:16.043516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:16.044564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:16.044564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:16.044564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.044564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:16.044564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 246/503] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:16.044956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.060176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 258/504] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:16.061033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.074963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.162481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4a90-5e79-4d05-adc1-8636cb80272b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.171197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad349a-bcca-4c13-8c41-fb246f967c8e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.201258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.202114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.202331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.202639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.213321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.214327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.214327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.214562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.215405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:16.215620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.216524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.217014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4791e-fe99-43f9-87e1-b7fbe4743d36 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.217978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.218576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.230517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 259/505] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:16.231856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.232152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.232460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:16.236525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:16.237893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:16.238818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:16.238818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:16.238818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.238818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:16.238818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 247/506] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:16.239100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.252604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:16.254845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:16.327444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.342425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 260/507] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:16.342425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.367599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a8196-3a30-4635-b27e-383e64e8ca0e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.407177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.407955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.408244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.408530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.409359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:16.409675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.411242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.426217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 248/508] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:16.427042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.452117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cbb9-7ac2-43ea-948d-16909565dae7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.479575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.489748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.490602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.490895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.491175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.498778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.500323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:16.518510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:16.520215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:16.521143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 261/509] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:16.521689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.549943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71db92-26a7-447c-8332-a43373b9a5a8 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.588465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.589515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.589952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.590402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.593443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.605492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.607223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:16.629694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:16.630711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:16.631556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:16.631556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:16.631556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.631556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:16.631556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 249/510] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:16.631823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.639865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f17e09-0fc3-4665-9869-f35f75e91b18 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.684530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.685213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.685499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.685783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.686551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:16.686865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.688307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.701727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 262/511] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:16.702957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.752341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e171b3-da80-411d-9311-1cbee755747e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.757909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.791342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.792146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.792430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.792706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.805607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.807212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.824323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4b6d0-0dfd-4a8c-84bf-0063b1a3ac0a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:16.827446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:16.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:16.834534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:16.834534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:16.834534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:16.834534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:16.834534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 250/512] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:16.834534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.869855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.870692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.870974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.871241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.878166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.879070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.880559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:16.896496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:16.897424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:16.898312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 263/513] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:16.899067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.947169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b51c3-c533-4ed3-b610-ee718b1d8db8 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.983473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.984279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.984641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.984992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.985855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:16.986174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.988498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.007473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676586a-4ea5-44b0-b4b0-b25690bc19ab None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.014682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.031089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 251/514] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:17.032436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.047771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.048675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.048785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.048963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.050335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:17.050737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.052115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.064032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 264/515] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:17.064922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.142757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.147381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3fa0-0ee7-4bcf-a0e4-e8c1f3071459 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.171078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221111-eac0-4899-9964-887cdfb9b2e4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.187331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.188225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.188514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.188797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.196766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.198520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.208853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.209602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.209961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.210314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.211210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:17.211576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.213040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:17.215096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:17.215891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:17.216746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:17.217150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 252/516] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:17.217979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.226701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 265/517] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:17.227468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.256847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.333897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc96a-4d3b-4ad2-a941-16010bf8c9b6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.343507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eefd5-c703-4dab-a3c3-55487957af06 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.373145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.373815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.374099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.374544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.375241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:17.375551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.377016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.380107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.381558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.381863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.382129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.396118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 253/518] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:17.396951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.416393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.460227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.462008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.491152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.504532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485a409-40a4-4d18-935d-e9dcae435aab None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.542960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.543998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.544435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.544718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.555087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.556566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.570160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 266/519] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:17.571374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:17.571662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:17.572507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:17.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 254/520] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:17.574078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.662415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.687616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86425613-89dd-4bfe-b9f6-9331ea419655 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.689270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab401d-428f-4eda-acac-8f8a2523c809 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.716603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.727414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.728133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.728483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.728833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.730144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.730862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.731027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:17.731135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.731349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.731437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.732161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.732823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.733553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.754884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 267/521] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:17.756790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 255/522] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:32:17 2022] POST /identity/v3/users => generated 247 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:17.757707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.759802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.908467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf414a1-470d-42a5-8133-64bf48e5f30c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.914628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e862-9479-46be-8b16-0fd4ddf9ef5f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.963887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:17.969467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.969670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.969951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.970250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.972151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.973209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.974173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.974385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.989366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.991738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:18.014169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:18.015118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:18.015937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:18.015937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:18.015937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:18.015937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:18.020235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 256/523] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:18.021137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.047224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.067749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.069258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.143996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7603c8-438d-4051-9133-e01e5cbe8c88 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.195616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.196651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.197131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.197612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.198529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:18.198835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.199318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 268/524] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:18.200221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.200697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.224897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 257/525] 10.222.0.64 () {56 vars in 1139 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:18.224897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.287362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.320475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.339464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5fba-3b35-4c85-9f57-8763438abc8c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.359460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f053f-96eb-4c46-aea8-04fbaa400d8a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.384884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31897684-b7ab-4051-a150-612723632935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.386134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31897684-b7ab-4051-a150-612723632935 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.386593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31897684-b7ab-4051-a150-612723632935 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.387069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31897684-b7ab-4051-a150-612723632935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.387908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31897684-b7ab-4051-a150-612723632935 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=a3981687a6c741afbd3d22eb49fe4da7) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:18.388221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31897684-b7ab-4051-a150-612723632935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.389646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31897684-b7ab-4051-a150-612723632935 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.397366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 269/526] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/role_assignments?user.id=a3981687a6c741afbd3d22eb49fe4da7&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:18.397924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31897684-b7ab-4051-a150-612723632935 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.419212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.419905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.420196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.420530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.421226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:18.421532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.422997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.444679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 258/527] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:18.446101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.565746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31897684-b7ab-4051-a150-612723632935 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.586291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1db96-bed7-46de-8938-efefda3a65ec None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.589815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.639145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.641582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.642213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.642725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.647398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.647771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.648270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.648559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.676515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.682851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:18.714961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:18.716162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:18.717204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:18.717204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:18.717204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:18.717204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:18.723478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 270/528] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:18.724806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.727766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.784513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.787890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.925396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 259/529] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:18.925396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.926231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.943166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41f33-0eee-470f-a484-ba00d0979a5c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.009057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.009841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.010174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.010405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.025892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.027495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:19.051192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:19.052067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:19.052913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:19.058950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 271/530] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:19.065610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.119821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5828-8fdb-4c72-8edb-2425355f9ba1 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.185920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.186540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.186826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.187108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.187836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:19.188140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.189520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.192830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.222743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 260/531] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:19.223635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.271296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9da1-475e-4f25-b86a-0ac3379e32e5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.324502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.325905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.326770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.327254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.341435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.343301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.346640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:19.383630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:19.384537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:19.385824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:19.385824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:19.385824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:19.385824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:19.389099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 272/532] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:19.390267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.411996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb6a16-8432-4d10-8c15-ea0542d5a32e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.477476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.478077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.478370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.478650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.479457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:19.479768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.481218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.523032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 261/533] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:19.523991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.574387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcb02b-fd5a-4b56-8409-c50da73c032a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.591912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.629349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.629349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.629349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.629709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.641223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.642729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:19.673323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:19.674220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:19.675151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:19.683838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 273/534] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:19.690716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.728671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec72456-e5f3-45c4-84a0-26b152bb7440 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.761687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.785739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.788457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.788773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.789065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.789821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:19.790140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.791581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.814426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 262/535] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:19.814426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.860850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcde63-0e3b-4f47-b9b6-59e7be181840 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.922400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.922400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.922400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.922400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.922789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=58e091aa0ceb4548999be36c96c7dc04) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:19.922789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.924297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.942401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 274/536] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/role_assignments?user.id=58e091aa0ceb4548999be36c96c7dc04&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:19.942401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.995104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7826f6-5687-42ad-b1a7-08216259d813 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:20.038388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:20.078388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:20.078388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.078388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.078388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.078796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:20.078796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:20.079587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b8a4-c91d-45a8-a94b-9e57f6a6f4bc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:20.109527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 263/537] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:20.115573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b3c9-5cc7-4f70-af3d-a2a302646464 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.115573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b3c9-5cc7-4f70-af3d-a2a302646464 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.115780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b3c9-5cc7-4f70-af3d-a2a302646464 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.117169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 264/538] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:20.121424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153b3c9-5cc7-4f70-af3d-a2a302646464 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:20.193776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:20.208686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45485b-d3fd-4f9c-ae0f-476aa027fd3b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:20.297213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153b3c9-5cc7-4f70-af3d-a2a302646464 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:20.326515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:20.327223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.327514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.327800 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.347893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:20.349760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:20.357455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:20.358107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.358416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.362477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.363379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=ef1660a20af64b189516d5dd4b31a9d2) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:20.363708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:20.365174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-493b2ba8-ca35-4307-9624-33731738e042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:20.379417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:20.380304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:20.381141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:20.382442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 275/540] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:20.383697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171920e-5fce-485e-a89c-caf306f0c1a4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.383989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171920e-5fce-485e-a89c-caf306f0c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.384275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171920e-5fce-485e-a89c-caf306f0c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.385694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 265/540] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:20 2022] GET /identity/v3/role_assignments?user.id=ef1660a20af64b189516d5dd4b31a9d2&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:20.390466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:20.428824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6171920e-5fce-485e-a89c-caf306f0c1a4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:20.430424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6171920e-5fce-485e-a89c-caf306f0c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:20.602575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 276/541] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:20.605427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5bdfa-314c-4def-ac18-1b44ded8a0f0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:20.616274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d4285-85ea-4c90-afe4-9c1543438ac5 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.616577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d4285-85ea-4c90-afe4-9c1543438ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.616845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d4285-85ea-4c90-afe4-9c1543438ac5 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.618219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 277/542] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:20.619817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:20.630756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.631402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.631919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.658392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:20.658392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.660005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.660005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.664185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:20.664185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:20.664185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:20.665816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:20.668410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:20.690917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 266/543] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:20.690917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:20.712492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:20.797679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 278/544] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:20.800393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:20.892913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674407-77b7-463d-af26-336cff03c98b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:20.960082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:20.960888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:20.961182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:20.961459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:20.980844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:20.989707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:20.990864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:20.991654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:20.993967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3acc9-32a5-4253-8dc5-3040cab00b2e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:21.000178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 267/545] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:21.000178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:21.044292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:21.045597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:21.046106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:21.046776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:21.047989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=4c7f97cf493c4b118a96025ee33f27a6) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:21.048481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:21.050187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:21.057076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:21.059191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 279/546] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:20 2022] GET /identity/v3/role_assignments?user.id=4c7f97cf493c4b118a96025ee33f27a6&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:21.060297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:21.093098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:21.189109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fe089-b69e-47d9-9794-92c336966b85 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:21.239965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:21.241011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:21.241499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:21.242002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:21.243019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:21.244353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:21.247643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b777-1bc4-46d4-b8e6-a8893209ab87 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:21.250203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:21.266304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 280/547] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:21.273173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:21.307485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:21.309080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:21.309581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:21.310931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:21.327641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:21.339800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:21.340731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:21.341523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 268/548] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:21.352097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:21.469834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:21.488436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56038-1c9d-44c6-b470-b0698fe0647e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:21.538288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:21.539134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:21.539417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:21.540261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:21.561407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:21.567499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:21.573297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:21.596804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f2e5-e7d0-4d8e-a509-a8a5550b59cc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:21.601139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:21.602523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:21.603623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:21.603623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:21.603623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:21.603623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:21.606005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 281/549] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:21.615791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:21.724808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:21.725441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:21.725737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:21.726024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:21.726972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:21.727233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:21.729592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:21.748799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 269/550] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:21.758708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:21.779559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8f194-aac1-4386-8471-e56bf0083f36 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:21.822545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:21.823672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:21.824184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:21.824663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:21.825693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:21.826307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:21.828006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:21.838872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:21.852607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 282/551] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:21.858518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.066667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b2db-c569-412b-8a1b-f71e3eb894da None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.158383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504e16-6b18-4bde-a1f3-907509827161 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.190479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.194377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.194377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.194377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.230390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:22.236171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:22.250182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.250996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.251282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.251559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.254521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:22.270258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:22.272398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d3797d43-aad2-4116-91f1-5e9edfcac369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:22.276818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:22.277785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:22.278654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:22.278654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:22.278654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:22.278654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:22.291609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 270/552] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 533 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:22.296296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7119a9-2b60-4fb4-bb81-f6c8496a5c05 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.296805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7119a9-2b60-4fb4-bb81-f6c8496a5c05 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.297305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7119a9-2b60-4fb4-bb81-f6c8496a5c05 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.301674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 271/553] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:22.302922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7119a9-2b60-4fb4-bb81-f6c8496a5c05 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-248cbd28-6dcb-401f-8595-fd07b219f2eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:22.315651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:22.316611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:22.317568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 283/554] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:22.324727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.324727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.324727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.372666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:22.372666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:22.480197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:22.519645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 284/555] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:22.521952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.545761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7119a9-2b60-4fb4-bb81-f6c8496a5c05 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.611880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.612624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.612914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.613191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.615082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:22.615406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:22.616851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:22.635919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 272/556] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:22.635919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.701599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b828a-e983-4d65-b252-c594d25a91a3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.709684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:22.759111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.760194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.760696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.761178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.762256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:22.762841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:22.765087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:22.781479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea3ce9-9cdc-4549-9225-bb540a45a5d9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.804028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 285/557] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 19 15:32:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:22.805860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.856794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.857962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.859075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.859572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.882950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:22.901617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:22.903433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:22.904871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:22.905705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:22.910647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 273/558] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:22.911506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.021187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae181b-a7e4-4ca5-896f-ffe5fa7dc1aa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.067247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.068052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.068333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.068767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.080068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.081366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7b8cc-f270-4cea-9c4a-248fc826ee55 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.082374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:23.100298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:23.101277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:23.102298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:23.105269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.106694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 286/559] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:32:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:23.107575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.122967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7a33-cbe0-46fb-a960-2a3c614a2be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.123730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7a33-cbe0-46fb-a960-2a3c614a2be5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.126624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7a33-cbe0-46fb-a960-2a3c614a2be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.126968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7a33-cbe0-46fb-a960-2a3c614a2be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.217427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b7a33-cbe0-46fb-a960-2a3c614a2be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.219099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b7a33-cbe0-46fb-a960-2a3c614a2be5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.251333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52cadd-ea3b-4f2e-b9d1-9c89bb79a480 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.255379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.294886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.295594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.295847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.296162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.296882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:23.297188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.298607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78145a04-8c8e-46b6-a974-bd70b670e6c7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.312592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 287/560] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:23.312592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98e63-b5fe-464d-ba08-23f1d03fba6e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.312592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98e63-b5fe-464d-ba08-23f1d03fba6e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.312592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98e63-b5fe-464d-ba08-23f1d03fba6e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.312592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 288/561] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:23.312592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98e63-b5fe-464d-ba08-23f1d03fba6e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.342413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 274/562] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:23.343790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.344088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.344374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.364480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:23.366066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:23.392009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.428957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98e63-b5fe-464d-ba08-23f1d03fba6e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.465993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.466770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.467067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.467348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.468247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:23.468527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.470411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.482880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 275/563] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:23.484179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.489494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 289/564] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:23.494870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.528820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.630702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0c6a-1a66-4441-90b2-aae1f23dad4e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.644060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5534-6e84-498b-af95-b6cbd8847004 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.666253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.667107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.667397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.667678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.680092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.681560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.682465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.683309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.683547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.683831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.694717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.696177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:23.699879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:23.700761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:23.701624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:23.701624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:23.701624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:23.701624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:23.705774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 290/565] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:23.706676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:23.714261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:23.715159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:23.716079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:23.716079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:23.716079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:23.716079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:23.716079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 276/566] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:23.716805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.721398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.797906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.825452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7e240-e916-45d3-b6d5-554582dbcf4b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.836892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d0ba-fe12-4cca-aaa6-ef08aefb8dbe None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.862576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.863545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.863914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.864262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.871493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9946a0d-e759-4817-afd4-c809df5e3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.872274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9946a0d-e759-4817-afd4-c809df5e3c87 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.872557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9946a0d-e759-4817-afd4-c809df5e3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.872832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9946a0d-e759-4817-afd4-c809df5e3c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.875757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.877378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.883731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9946a0d-e759-4817-afd4-c809df5e3c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a9946a0d-e759-4817-afd4-c809df5e3c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:23.891395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:23.892291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:23.893109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 277/567] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:23.895093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5ec6-65a4-4165-a60d-8801ec77d938 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.895204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5ec6-65a4-4165-a60d-8801ec77d938 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.895420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5ec6-65a4-4165-a60d-8801ec77d938 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.896809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 278/568] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:23.897339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5ec6-65a4-4165-a60d-8801ec77d938 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:23.902014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:23.903031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:23.903900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:23.903900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:23.903900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:23.903900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:23.903900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 291/569] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:23.903900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.991158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.018107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521815f7-bc1c-4f18-a3b8-1dedb0a1bb98 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.039050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5ec6-65a4-4165-a60d-8801ec77d938 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.047562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.060290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.060966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.061251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.061531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.062261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:24.062605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.063972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.079364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.080239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.080676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.081014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.081753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:24.082058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.082777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 292/570] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:24.083520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7bf6-0fe9-4018-9601-2fda34807e14 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.083652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.095421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 279/571] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:24.097244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98655e72-96c6-4906-a504-291d4b788021 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.097530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98655e72-96c6-4906-a504-291d4b788021 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.097802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98655e72-96c6-4906-a504-291d4b788021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.117911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-98655e72-96c6-4906-a504-291d4b788021 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:24.117911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-98655e72-96c6-4906-a504-291d4b788021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.190377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 280/572] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:24.191979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb6f5c-753e-414f-af98-a13521a85d11 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.195186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98655e72-96c6-4906-a504-291d4b788021 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.246866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.247431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.247721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.248010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.248747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:24.249066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.250451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.252590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.259554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 293/573] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:24.259554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.309045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98655e72-96c6-4906-a504-291d4b788021 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.316487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.344671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.345422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.345704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.345981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.346881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:24.347242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.348684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.360642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 281/574] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:24.361723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.371326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac5f1d-d8b8-46cf-8f9d-59cbb3e55087 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.411359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.412148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.412465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.412710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.421157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.422629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:24.438064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:24.439270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:32:24.441191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:24.442232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 294/575] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:24.442980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.474948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa928e-ec0e-47c7-979e-fd77a96b828d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.488273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.512432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.513158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.513452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.513724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.520419 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.521878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:24.536208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:24.537083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:24.537948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 282/576] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:24.538481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.553902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc654ca-a133-4d29-89ac-daafd86d28d0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.564566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.594322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.595147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.595432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.595723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.607652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:24.615716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:24.616826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:24.617811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:24.621938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 295/577] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:24.622695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.649502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ce46-c253-4292-8755-f2619d599cde None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.685714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.686554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.686840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.687120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.698842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.700290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:24.718719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:24.719645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:24.720544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:24.720544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:24.720544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:24.720544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:24.720544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 283/578] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:24.720854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.734513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4540-558a-4ad1-8710-10534278477e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.746917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.773641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.774396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.774683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.775306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.782063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.783596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:24.798916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:24.799885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:24.800856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 296/579] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:24.801375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.833196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.838924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacb2c1-e769-40df-8242-d6f9dbac7d0a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.874906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.875580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.875862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.876140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.876987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:24.877302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.878898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.895894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 284/580] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:24.896707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.904064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420f2a-511a-42e1-89d5-c1bf15f064b7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.938141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.938856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.939151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.939434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.940809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:24.941123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.942581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.954065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 297/581] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:24.954884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.983006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.003506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8d8d7-604b-4961-8363-75cdeae99e86 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.037686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.038292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.038608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.038893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.039646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.039960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.041356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.044578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.049327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 285/582] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.050248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.054855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9313744-83f2-44a3-a521-312db239b706 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.088965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.089737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.090024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.090303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.091058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.091370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.092735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.104913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 298/583] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.105867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.155494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c9426-3f70-45a8-805f-f1ff48a59541 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.188330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.188985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.189272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.189552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.190392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.190848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.192290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.202008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7cb7b-44a2-4943-8e97-bf3ed810e45d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.209359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 286/584] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.209359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.212856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.236913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.238259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.238575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.238855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.248715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.250166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:25.267995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:25.269087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 299/585] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.275472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.311599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f35d4-cedb-4103-b277-ad8f54291747 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.346056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.347359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.347698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.347976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.348805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=b06c607bcb83464791b3c0b965bce133) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.349114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.350569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.356106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 287/586] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/role_assignments?user.id=b06c607bcb83464791b3c0b965bce133&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.356870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.393058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ddc7e-8a27-4791-9ff0-8775da91418b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.431096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.438259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.439114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.439397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.439673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.455189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.457590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.468901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5f61a-4036-45c0-8bc6-1a35968310dc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:25.480987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:25.481941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:25.482890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:25.482890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:25.482890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:25.482890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:25.486539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 300/587] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:25.488240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.513475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.514280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.514600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.514881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.524067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.525843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:25.541081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:25.542036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 288/588] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:25.543342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.556718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.607456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7358eef-dd78-4559-9423-caf2266fe25a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.644744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.645793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.646138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.646525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/a3981687a6c741afbd3d22eb49fe4da7/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.652470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502b961-7d62-49b9-bf8f-07bb442d0476 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.664772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=a3981687a6c741afbd3d22eb49fe4da7, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.666221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.681220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 301/589] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:25 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/a3981687a6c741afbd3d22eb49fe4da7/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:25.681843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.695895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.706607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.707693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.708054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.708407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.709357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.709830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.711588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.727260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 289/590] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.728398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.835950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d614c4d-61de-4cd5-9c34-72d61d19b024 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.851413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.866204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e57dc0-5172-45fc-9f58-930bf59c1fff None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.893606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.894302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.894617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.894897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.895669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.896531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.897735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.913193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 302/591] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.913683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.958679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.959356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.959639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.959915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.960762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.961072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.965544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.990942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 290/592] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.991544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.063395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.067704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde590-25e1-4b73-9094-547184fa28e1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.129448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745adb-ec99-4bec-a299-32e8369f96ed None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.130078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.130931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.131277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.131559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.139547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.141013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:26.161770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:26.162958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:26.164044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:26.166730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 303/593] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:26.167619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.174775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.175945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.176356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.176754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.185385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.187945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.199194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:26.211588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:26.212558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:32:26.213463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:26.216407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 291/594] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:26.217446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.305371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3515c8-5c55-473c-98d0-6a050c0e42a3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.346106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.347693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.348063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.348392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.358726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa619e-578f-4009-b4dc-9f4987eb7f54 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.359870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.362245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.368921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:26.390298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:26.391250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:26.392100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:26.392100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:26.392100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:26.392100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:26.394688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 304/595] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:26.395624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.434286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.435194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.435492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.435780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.437685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:26.438014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.443037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.478390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 292/596] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:26.478390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.497954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.527378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ea8bc-3839-4d70-bc85-1c9dca389339 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.564154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.564823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.565740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.570390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.570390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:26.570390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.570390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.589004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 305/597] 10.222.0.64 () {56 vars in 1139 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:26.590004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.629740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992e8b-1ec7-4852-a270-773d6b9c7b38 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.665291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.665883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.666174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.666486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.667216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:26.667535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.668916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.691295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 293/598] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:26.692213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.722487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5114d-bc46-4237-956f-6452d04c296e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.725919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.767311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.768268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.769308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.769588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/58e091aa0ceb4548999be36c96c7dc04/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.772550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.790491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=58e091aa0ceb4548999be36c96c7dc04, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.791949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.808029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0877-f38c-4d49-ab89-43a5bd42f651 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.818466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 306/599] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:26 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/58e091aa0ceb4548999be36c96c7dc04/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:26.819508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.850803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.851975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.852494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.852975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.865128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.867137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:26.888294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:26.889233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:26.890121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:26.890121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:26.890121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:26.890121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:26.892455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 294/600] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:26.898611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.011125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:27.037462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d73e68-2d22-4db3-9bf0-41683deb0043 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.048593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f24ce-3b49-4e5f-b04a-1d8e07ad247e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.074749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.075797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.076288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.076771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.077721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:27.078141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.079660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.093622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.094481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 295/601] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:27.094833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.095244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.095672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.100909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.107012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.108700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:27.127431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:27.129090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:27.129976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:27.132763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 307/602] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:27.139356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.193151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:27.254113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233934d9-b3d2-4b29-ad18-63fd25c629e5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.293045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.294379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.294833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.295382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.296448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:27.296902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.298734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.314161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 308/603] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:27.316815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4488931-07fd-4049-ae6f-42ff81216630 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.319931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.432569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2992041-40ff-45f8-bc94-6f8b7a697cbb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.459156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.459923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.460216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.460547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.462720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:27.471444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.473353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.473826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.474279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/ef1660a20af64b189516d5dd4b31a9d2/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.491252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.491823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=ef1660a20af64b189516d5dd4b31a9d2, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.492734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.493963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.500136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:27.517323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 309/604] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:27 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/ef1660a20af64b189516d5dd4b31a9d2/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-5e20545c-d478-4f90-9bd1-d4b5e26e84cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:27.522616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:27.523518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:27.524381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:27.527279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 296/605] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:27.535556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.615059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912f762-246a-429f-928e-ca921349726b None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.615708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912f762-246a-429f-928e-ca921349726b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.616168 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912f762-246a-429f-928e-ca921349726b None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.617989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 297/606] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:27.623835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.624119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.624414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.645972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:27.647226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:27.684155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bd874-346e-4b2d-af79-a38420873f60 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.723176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.723884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.724174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.724458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.725266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:27.725584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.727148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.745671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 310/607] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:27.746552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.788541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:27.794526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 298/608] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:27.814065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.890069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a8ad-31a7-49fc-bb14-f37afa17bd33 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.956524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88435753-612e-4de8-8d5f-24c88e745c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.957420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88435753-612e-4de8-8d5f-24c88e745c27 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.957700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88435753-612e-4de8-8d5f-24c88e745c27 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.957977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88435753-612e-4de8-8d5f-24c88e745c27 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/4c7f97cf493c4b118a96025ee33f27a6/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.979894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88435753-612e-4de8-8d5f-24c88e745c27 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=4c7f97cf493c4b118a96025ee33f27a6, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.980679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba876a1-b821-4e95-806d-d4ac69f81384 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.981343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88435753-612e-4de8-8d5f-24c88e745c27 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.995853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 311/609] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:27 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/4c7f97cf493c4b118a96025ee33f27a6/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:27.997390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c680ee4-0cc9-4d8a-984f-df26d7461a2e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.997687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c680ee4-0cc9-4d8a-984f-df26d7461a2e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.997968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c680ee4-0cc9-4d8a-984f-df26d7461a2e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.999721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 312/610] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:28.008250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.008732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.008990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.019595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.030086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:28.031076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.031360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:28.032306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.032792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.033701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.053780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:28.065095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:28.066877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:28.067707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:28.075759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 299/611] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:28.077812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.115373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.125925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 313/612] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:28.151109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.214550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5d4d8-7670-4b78-aff1-958da09f28f0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.278352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.279192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.279483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.279776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.280548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:28.280864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.282505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.293200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 300/613] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:28.299028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.303511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56e1c2-6a00-43bb-9173-4211903acfba None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.339755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.340554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.340839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.341117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.353947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:28.357420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:28.361622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:28.363390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:28.364242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 314/614] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:28.370463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.461059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bd582-6394-42a5-a9c7-3e5e77956530 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.465930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.527240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.528042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.528327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.528606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.543754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5de97-096f-4e16-a106-1143940ca37e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.551212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.552681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:28.579209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:28.580152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:28.581719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:28.581719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:28.581719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:28.581719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:28.581719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 301/615] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:28.587890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.615125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.615805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.616089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.616363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.617115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:28.617419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.619005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.628596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 315/616] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:28.634129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.745262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144bba-b5cd-40e1-a0da-06b12bb6b481 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.763501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.792103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.793279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.793969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.795652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.813868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.817515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384dfe-da7d-4bb0-bf47-d0c1a58e13f3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.819921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.821519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:28.857261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:28.858230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:28.859532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:28.859532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:28.859532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:28.859532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:28.864408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 316/617] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:28.870707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.880789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.881812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.882303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.882814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.884225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:28.884748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.886327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.900675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 302/618] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:28.905875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.054484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff815-0a26-4ace-8ea8-9921e168b9fa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.095977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8c18d-8fc7-4152-92bb-4e6a99f71a2b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.119032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.119702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.119991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.120274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.121012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:29.121323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.122725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.144889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 317/619] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:29.149395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.162240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.163061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.163354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.163630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.174467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.176231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.202850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:29.203553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:29.204667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:29.205694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:29.206240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 303/620] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:29.213665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.242790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.359517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b29140-e605-489a-a181-e95621d9a6bf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.363269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132717-9447-4cd5-91cb-80c89a640f77 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.397528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.398320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.398650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.399093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.400736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:29.401593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.403115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.426442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 304/621] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:29.434176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.435318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.435804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.436322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.447462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.449218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.453786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:29.484405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:29.485454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:29.486424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:29.493915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 318/622] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:29.499844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.571810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.600483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e3204-2b0f-49c7-bb87-657939f2df8c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.630019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.639132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.640214 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.640800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.641373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.645581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80539122-356b-4313-b884-9a7120fb29b9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.653812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.655631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-0b0c9e7a-fd2b-4f1f-b981-a205f4a000cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:29.680671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:29.681618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:29.682529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:29.682529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:29.682529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:29.682529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:29.689229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 305/623] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:29.689229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e736b-c47c-461b-ac5a-5fb37ddd1e96 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.689229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e736b-c47c-461b-ac5a-5fb37ddd1e96 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.689229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e736b-c47c-461b-ac5a-5fb37ddd1e96 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.694665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 306/624] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:29.695682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e736b-c47c-461b-ac5a-5fb37ddd1e96 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.701235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.701915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.702191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.702502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.703360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:29.703677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.705149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad3cf-0770-466d-9e84-9169c538cdf3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.729983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 319/625] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:29.731389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.731651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.731936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.748709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:29.749965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.829636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e736b-c47c-461b-ac5a-5fb37ddd1e96 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.830072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 320/626] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:29.831598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.866369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.873931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.875189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.875935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.876412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.878477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:29.879184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.880912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.899882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 307/627] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:29.901324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.933309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.965529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3f72-e5f2-4bd8-ade5-794347664d2e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.003851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795756-2741-44c6-913b-a9030d072c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.004800 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795756-2741-44c6-913b-a9030d072c88 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.005001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795756-2741-44c6-913b-a9030d072c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.005227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795756-2741-44c6-913b-a9030d072c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.038553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1dbe-99dc-4161-b025-ac37d4f9845b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.079798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.080675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.080998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.081281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.090783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795756-2741-44c6-913b-a9030d072c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.092225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795756-2741-44c6-913b-a9030d072c88 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.093320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:30.101939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:30.103312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:30.104220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:30.107067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 308/628] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:30.108338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.167368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.179890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.210792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 321/629] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:30.210792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67a742-45f8-42f9-816c-7dcba5e62468 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.210792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67a742-45f8-42f9-816c-7dcba5e62468 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.210792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67a742-45f8-42f9-816c-7dcba5e62468 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.210792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 322/630] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:30.210792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67a742-45f8-42f9-816c-7dcba5e62468 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.223782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9ac1f-ffb0-4b76-9a97-61c94617215a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.262719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.263503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.263788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.264067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.270964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.272412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:30.287061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:30.287996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:30.288858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 309/631] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:30.289343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.343443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67a742-45f8-42f9-816c-7dcba5e62468 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.378736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.379410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.379700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.379977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.380734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:30.381041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.382431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075c848-8146-4c81-9601-1f362e1924af None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.390481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 323/632] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:30.391751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.392044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.392322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.398091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c50ea-5347-4ec4-bc2b-de6741db4acf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.409556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:30.412097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.412592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.436367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.437474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.437930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.438197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.443404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.454193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.455785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:30.473928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:30.475126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:30.476174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:30.476174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:30.476174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:30.476174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:30.476174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 310/633] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:30.476515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.486324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 324/634] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:30.487736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.589650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108836b8-5743-47db-bfec-e3818698ede7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.591729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6891f9-05c1-4828-8202-399d704dec26 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.623719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.624483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.624771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.625051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.629598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.630251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.630570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.630849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.631642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:30.631954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.633387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e1c57-f72d-4001-ace1-dbec0b3f722c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.635817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.637254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.645768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 311/635] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:30.647120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126f17-9bd8-4c98-8632-0ce4ffbba3cb None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.647423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126f17-9bd8-4c98-8632-0ce4ffbba3cb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.647698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126f17-9bd8-4c98-8632-0ce4ffbba3cb None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.653101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 312/636] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:30.653101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126f17-9bd8-4c98-8632-0ce4ffbba3cb None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:30.656151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:30.657228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:30.658335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:30.658335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:30.658335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:30.658335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:30.658335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 325/637] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:30.658335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.681430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.684088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.759080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1fff2-5bfe-460d-9637-c87b5476f9da None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.760248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126f17-9bd8-4c98-8632-0ce4ffbba3cb None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.793462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000b590-f4eb-4eb2-b144-5409c9050994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.794250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b590-f4eb-4eb2-b144-5409c9050994 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.794472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.794599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b590-f4eb-4eb2-b144-5409c9050994 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.794841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b590-f4eb-4eb2-b144-5409c9050994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.795097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.795385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.795664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.796385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:30.796693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.798071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.805154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000b590-f4eb-4eb2-b144-5409c9050994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:30.809232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 313/638] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:30.809913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e000b590-f4eb-4eb2-b144-5409c9050994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:30.812849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:30.813839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:30.814750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 326/639] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:30.815980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.817004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.817004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.832960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:30.834135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.895865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.899997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 327/640] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:30.901161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.912485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8515133-0d7b-4d41-9376-304228fd6212 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.927340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.952295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.953181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.953466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.953747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/b06c607bcb83464791b3c0b965bce133/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.968610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=b06c607bcb83464791b3c0b965bce133, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.970067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.983027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 314/641] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:30 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/b06c607bcb83464791b3c0b965bce133/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:30.983826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.038398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c39c2-8f09-4347-b9b9-83d6f7355bfb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.079067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.079753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.080340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.081366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.082341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.082674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.084652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.098187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 328/642] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:31.099099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.109196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1115fd-ca46-4c0b-b48f-644886d95581 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.152414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.153217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.153503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.153783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.155802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.162881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.164512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:31.178931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:31.180188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 315/643] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:31.181308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.182342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.216536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994ae75-98d2-4b6e-a425-f8c50914e8c8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.251284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.251958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.252246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.253187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.253853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.254167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.255617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.264364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 329/644] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:31.265204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.291980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19dd88-d129-4f5e-8a05-b0dbea07309f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.328437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.329221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.329506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.329783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.340414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:31.348880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:31.349818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:31.350724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 316/645] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:31.351555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.380003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b523-657b-4f25-823a-c0db04764afd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.410825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.420546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.427506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.428511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.428825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.429105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] PATH_INFO: `/v3/users/glance` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.437347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.438829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:31.453976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:31.455180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 330/646] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:31.456281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.468520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbe955-ad50-4a72-91fb-8f979cf4ffbd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.506142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.507057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.507495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.507770 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.508646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.508957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.510443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.522980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 317/647] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:31.523824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.569943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf87e4-9990-4c6d-a01b-0e3e3330a38d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.606649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.607776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.607776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.607976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.619536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.620984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.634258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95ba57-f295-48f3-bb8c-8ceb51e60caf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:31.639022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:31.639914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:31.646309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:31.646309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:31.646309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:31.646309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:31.646309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 331/648] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:31.646309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.655207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.680254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.681033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.681394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.681747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.682635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.683024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.684504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.699134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 318/649] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:31.699134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.704381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.761859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cc701-f4da-4b25-9e62-d53d77ca3d91 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.796369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.797038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.797327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.797600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.798462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.798877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.800775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.806592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc623a-129c-43e7-afbb-b4191f692459 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.819173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 332/650] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:31.819784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.847610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.848275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.848564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.848849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.849682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=a3981687a6c741afbd3d22eb49fe4da7) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.850021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.851471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.866400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 319/651] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/role_assignments?user.id=a3981687a6c741afbd3d22eb49fe4da7&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:31.866400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.915743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.939853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc90d-b306-40a5-982a-ee5271d4c174 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.942386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.983610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.984771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.985073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.985473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.986249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:31.986682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.988937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8339f11-84ff-4b3b-8857-4b10017aafbb None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.989287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.006742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 333/652] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:32.007949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.033393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.035270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.035831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.036323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.053205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.055359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:32.082225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:32.083237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:32.084555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:32.084555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:32.084555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:32.084555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:32.084555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 320/653] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:32.085388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.153486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cbfe-e8a3-48db-86f9-421fc0eeb953 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.200345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.201282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.201576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.201867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.211874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.223080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6ff5-9ccf-4b64-96fd-6bb357789516 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.242031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.263609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.264413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.264707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.265361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.275686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.277134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:32.292822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:32.293793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:32:32.294763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:32.295296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.295383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 321/654] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:32.295453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.295531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.409789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4b74-5e76-40ac-a72c-daddc2109a25 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.430162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 334/655] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:32.431080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.452470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.453140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.453523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.453807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.454573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:32.454885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.457389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.475885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 322/656] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:32.476822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.492962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.508214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.559832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade6f56-73be-4dbf-a90d-fc57be13b553 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.586577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adabf5-14c6-48d3-aad9-284b946e07fe None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.599098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.600152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.600552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.601428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.602781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:32.603461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.605444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.622142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.622990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.623272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.623548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.630222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 335/657] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:32.631728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.635009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.636468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:32.655229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:32.656173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:32.657065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:32.657065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:32.657065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:32.657065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:32.661933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 323/658] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:32.662782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.735514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.778639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64a13-92de-40ba-a520-27ffde4f2b2a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.779957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde4f5-55f9-4710-9683-43d60a89effe None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.807490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.818882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.819889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.820245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.820593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.827899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.828924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.829394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.829851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.841190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.843559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:32.860619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:32.861605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:32:32.862706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:32.867376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 336/659] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:32.867621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.914544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.917019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.987744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.990632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a9a7f-d328-48cb-9c5f-f7c1ef77068c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.030287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 324/660] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:33.031276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.040672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.041646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.043917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.043917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.044643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:33.044952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.046332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.063062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 337/661] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:33.064005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.108922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.152095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718de444-3c3d-4417-b2be-26ee32598e14 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.179118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4d704-3313-4e78-9412-e1b987c03866 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.193507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.194687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.195257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.195544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.196589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:33.196914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.198734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.215069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.215868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.216160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.216441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.225563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 325/662] 10.222.0.64 () {56 vars in 1139 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:33.227098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.229762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.231260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-608bf6e4-7fff-4e3d-8893-20f45d02c7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:33.249586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:33.250556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:33.251468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:33.251468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:33.251468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:33.251468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:33.251468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 338/663] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:33.252276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613ed54-dbcd-400c-b758-380d5ee2293e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.252504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613ed54-dbcd-400c-b758-380d5ee2293e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.252725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613ed54-dbcd-400c-b758-380d5ee2293e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.254270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 339/664] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:33.259397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613ed54-dbcd-400c-b758-380d5ee2293e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.261069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.343217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d09c7-2d95-462d-bb6a-a2c59a3b4f19 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.359763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.371276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613ed54-dbcd-400c-b758-380d5ee2293e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.380247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.381041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.381328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.381727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.389086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.390687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.407471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.408121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.408406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.409278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:33.410889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:33.411780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:33.412650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 326/665] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:33.413185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.486516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.487940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.500762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.524388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ab276-9541-46b5-a40a-d49f4680c262 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.562876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.563547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.563836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.564113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.564879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:33.565423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.567150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7d10b-eb84-489c-9a43-3d4d8b1a6777 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.580308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 327/666] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:33.582056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.582400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.582739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.602064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:33.603291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.606340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.622512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 340/667] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:33.622512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.707344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 328/668] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:33.707344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.763565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d7f75-975d-4d5c-a454-a446a79e6fe5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.811161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.811361 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.812031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.812333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.812745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.813589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:33.813907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.816329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.839597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 341/669] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:33.839597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.857316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146270b7-0d7f-4ef7-b4ee-aec142f4d7dc None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.904474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.909862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.910838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.914531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.914994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.922234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.923753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:33.941139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:33.942128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:33.943085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 329/670] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:33.943558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.967944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b52781-0fde-4f59-bbc1-291a2a538916 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.012117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.013023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.013315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.013644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.029080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.031034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:34.050308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:34.051276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:34.052153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:34.052153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:34.052153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:34.052153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:34.052153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 342/671] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:34.052979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.077448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164d96-bb10-43ff-8888-0d46f4487325 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.113956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.121453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.122406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.122702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.122976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.138438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:34.147415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:34.148426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:34.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 330/672] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:34.149967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.192985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96027-0b2b-4fe5-8d21-18aced0ba45a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.195429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.235843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.236928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.237402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.237860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.239380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=58e091aa0ceb4548999be36c96c7dc04) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.239905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.242282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.249165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 343/673] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/role_assignments?user.id=58e091aa0ceb4548999be36c96c7dc04&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:34.250017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.279266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b6e4-3ff0-40c0-9b00-de008a71c9aa None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.331872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.332997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.333479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.333960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.335416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.335944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.337984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.358553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 331/674] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:34.360074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.408651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac5d1e-eb76-4a02-b74a-488afe3933df None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.440555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.460032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.460703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.460987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.461263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.462399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.462399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.463771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8c21f-f19f-422c-9823-51e9815bfb68 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.479957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 344/675] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:34.484210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca091-0bd7-4ea3-8796-37f1ccb51e73 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.484667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca091-0bd7-4ea3-8796-37f1ccb51e73 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.485019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca091-0bd7-4ea3-8796-37f1ccb51e73 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.486255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 345/676] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:34.487641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca091-0bd7-4ea3-8796-37f1ccb51e73 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.504970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e86c6-be31-4d89-8cde-fda55a9cf94c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.526337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.541908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.542527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.542816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.543092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.543847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.544155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.545527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.558300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 332/677] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:34.558300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.629071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca091-0bd7-4ea3-8796-37f1ccb51e73 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.662320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126e6a8-86b6-4959-b65e-5ef01ede9c96 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.672707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.673939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.674294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.675396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.676146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=ef1660a20af64b189516d5dd4b31a9d2) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.676469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.677940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5041cd4-7d63-4fe0-ab77-dafdc1c7e0e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.678417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.686027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 346/678] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/role_assignments?user.id=ef1660a20af64b189516d5dd4b31a9d2&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:34.687370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.687666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.687949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.708286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:34.709655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.716901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.718146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.719330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.719824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.731511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.733305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:34.751819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:34.753415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:34.754310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 333/679] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:34.755020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.808782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 347/680] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:34.809907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.842137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.900617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06065-630d-4a34-941e-f7995d38dda1 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.941443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636a2d-efdc-4dd2-a08c-09e80f30210a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.950342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.951621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.951966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.952253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.966600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.968522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.993597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.994738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.995245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.995772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.996914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.997234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.998796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:35.000300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:35.001905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:35.003637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:35.003637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:35.003637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:35.003637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:35.007251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 334/681] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:35.014390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.016199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 348/682] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:35.021004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.051024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.149678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.167831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94aec-f2a2-4fa6-83f8-51dea9911f32 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.178098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ee5d-810b-4dd5-8e45-712e2cae7e51 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.219499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.220038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.220709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.220998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.221379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.221483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.221944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.222483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:35.222589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.222854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.224438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.236381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:35.241943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 349/683] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:35.241943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:35.251125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:35.252023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:35.253650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:35.255825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 335/684] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:35.256488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.358948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2cbf-a3d1-40c0-82e3-e488db9670e9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.388356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.397110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.397774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.398057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.398336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.399217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=4c7f97cf493c4b118a96025ee33f27a6) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:35.399520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.401280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.407825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 350/685] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/role_assignments?user.id=4c7f97cf493c4b118a96025ee33f27a6&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:35.408681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.410192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1abf-44d9-49b4-8a60-096a16d7d506 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.423696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.488514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.489710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.490200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.490778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.501185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.503618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:35.521782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:35.522855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:35.523907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:35.527553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 336/686] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:35.534248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.619242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae659-edc5-4c53-8b9c-38705fb32264 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.667369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.667973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.668261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.668536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.670447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:35.670447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.672373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.685502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a4883-4178-42ad-a2b8-eea5e41440f5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.690204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 351/687] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:35.698952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.731304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.731688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.731977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.732260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.733109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:35.733431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.734938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.753548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 337/688] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:35.760040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.765038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.793264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.834119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920f734-ff9c-44eb-995e-e7ef8c12b773 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.870880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.872559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.873079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.873557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.886088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.887863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.890004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f08410-eb2f-4736-9634-799b0949a502 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:35.906680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:35.907597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:35.908473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:35.908473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:35.908473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:35.908473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:35.911560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 352/689] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:35.917160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.927727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.928206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.928493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.928768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.999540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.001031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.004390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.029847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a9c1d-0825-4f96-bf42-a34638206962 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.053711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.070242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.071264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.071787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.072282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.073205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:36.073738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.075364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.090245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 353/690] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:36.096020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.111264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 338/691] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:36.117559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.205023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8b31-0000-4c08-9219-d9511c23d6cb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.226507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179882a-6a29-4476-9d9c-13a1244dcc01 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.229069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.243111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.244271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.244783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.245263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.253399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.255193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.267612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.270676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.270676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.270676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:36.276204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:36.277230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:36.278205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:36.280858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 354/692] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:36.285725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.285725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.286990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:36.303526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:36.304493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:36.305390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:36.305390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:36.305390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:36.305390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:36.305390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 339/693] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:36.310489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.351022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.433671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6310-6cd7-4a62-a208-304e8e15aeef None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.465581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755e686-935d-4e23-9f4e-aca3ee3ecfa5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.470139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.470982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.471657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.472253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.473147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:36.473601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.475134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.488780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 340/694] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:36.494496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.514226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.532979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.534205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.534205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.534491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.535180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:36.535501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.536954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.574187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 355/695] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:36.581963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.610711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe99dc-5a75-4a92-ad55-f158e952c1f1 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.647522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.648763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.649258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.649802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.657434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.659712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:36.686059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:36.687009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:36.687875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:36.691023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 341/696] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:36.696681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.737521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.741167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f65a2-915b-4ade-b115-18fcb2d017dc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.779929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db7321-ec12-4e55-aaba-03ec7f8523bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.780685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db7321-ec12-4e55-aaba-03ec7f8523bf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.781086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db7321-ec12-4e55-aaba-03ec7f8523bf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.781438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db7321-ec12-4e55-aaba-03ec7f8523bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.782683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.806861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c780875-e523-4ceb-ad67-c2a5738345a1 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.841325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.842179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.842582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.842928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.843791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:36.844302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.845673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02f35d-b4cb-4e28-be0c-28e66124795e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.858782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 342/697] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:36.861083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db7321-ec12-4e55-aaba-03ec7f8523bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.862848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db7321-ec12-4e55-aaba-03ec7f8523bf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.865012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988ac9-fad2-4339-a34f-934e6d8ed1e2 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.865389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988ac9-fad2-4339-a34f-934e6d8ed1e2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.865739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988ac9-fad2-4339-a34f-934e6d8ed1e2 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.870395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 343/698] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:36.870395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988ac9-fad2-4339-a34f-934e6d8ed1e2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.985640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.989058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988ac9-fad2-4339-a34f-934e6d8ed1e2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.992288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 356/699] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:36.993702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.994386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.994988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.015424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:37.017284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.033745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.035171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.035646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.036602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.037952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=b06c607bcb83464791b3c0b965bce133) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:37.038503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.040722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.044771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.058812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 344/700] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/role_assignments?user.id=b06c607bcb83464791b3c0b965bce133&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:37.058812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.154187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 357/701] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:37.177144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.247594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ee901-8c80-4331-b4e7-d7c610822a43 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.287724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.288220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.288512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.288801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.300427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.302087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.314267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f05f7b-cc91-4005-8201-369868b22a96 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a7febec9-59be-4677-a8fd-8fa7a15b56de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:37.322582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:37.323504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:37.324736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:37.324736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:37.324736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:37.324736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:37.324736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 345/702] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:37.325244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9327-e88c-47c2-8357-1f05e33f85dd None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.325244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9327-e88c-47c2-8357-1f05e33f85dd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.325512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9327-e88c-47c2-8357-1f05e33f85dd None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.327057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 346/703] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:37.329132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9327-e88c-47c2-8357-1f05e33f85dd None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.356866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.370821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.371703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.371979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.372266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.384490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.386231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.399096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-bf10fb6b-0e68-4974-9b37-d648456defb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:37.405012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:37.406150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:37.407426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:37.407426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:37.407426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:37.407426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:37.409119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 358/704] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:37.410464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.410861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.415710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.429994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:37.431387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.463051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9327-e88c-47c2-8357-1f05e33f85dd None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.501146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.502068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.503071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.503496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.504391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:37.504847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.506469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.514549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 359/705] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:37.515472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.523675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 347/706] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:37.526742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.652159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465f81-2433-437d-9748-ba82c9e9f975 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.667726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.671778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cc0bf-aa32-4dad-8a50-50cd6f237b8f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.691171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.703865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.705190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.705790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.706619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.708283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:37.708820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.711420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.718104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.718931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.719217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.719497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.727279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.728402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 360/707] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:37.728789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.729809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:37.757566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:37.758511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:37.759392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:37.762886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 348/708] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:37.763895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.862468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2654-41b0-4044-a2dd-90ffbba58bcf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.891415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba596-204f-4990-9896-21f2bcc1881a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.898031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.898894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.899184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.899463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.900122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.901766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:37.918323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:37.919408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:37.920275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:37.925458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 361/709] 10.222.0.64 () {56 vars in 1129 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:37.926429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.941038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.942319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.942936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.943660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.945091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.947276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.965044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.977590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 349/710] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/users => generated 254 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:37.979170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.071652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:38.082732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b219b-f2ea-4be4-8a9b-3e2d767bed7d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.142709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.144415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.144870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.145659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.146687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:38.147179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.148834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.177036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 362/711] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:38.184233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.199749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffb2c-8fa6-4bdc-83a5-47fec4a79a2f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.245859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.246578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.246876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.247139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.247855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:38.248164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.249541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48eb1-c405-4c1e-8694-74ece30703f7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.254993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 350/712] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:38.256557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ece88d-f549-45c6-b512-3daef32f4e69 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.256857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ece88d-f549-45c6-b512-3daef32f4e69 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.257143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ece88d-f549-45c6-b512-3daef32f4e69 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.258569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 351/713] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:38.260254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ece88d-f549-45c6-b512-3daef32f4e69 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.311826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:38.322109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d5aa-496a-4f91-bd57-4bd2fdcccd21 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.362770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.363480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.363773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.364123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.364998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=a3981687a6c741afbd3d22eb49fe4da7) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:38.365332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.367410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2261-ce09-4225-8a17-83d3c3794756 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.373641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 363/714] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:38 2022] GET /identity/v3/role_assignments?user.id=a3981687a6c741afbd3d22eb49fe4da7&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:38.378403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe29f8-a160-4997-be00-77d89983568b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.378403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe29f8-a160-4997-be00-77d89983568b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.378403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe29f8-a160-4997-be00-77d89983568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.407824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3efe29f8-a160-4997-be00-77d89983568b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:38.409350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3efe29f8-a160-4997-be00-77d89983568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.415751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:38.433933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ece88d-f549-45c6-b512-3daef32f4e69 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.482013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.482723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.483016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.483284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.484300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:38.484643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.487129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.499621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 352/715] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 19 15:32:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:38.546029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 364/716] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:38.584629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.738329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b1930-5071-42a0-94a5-6afd88521ae0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.774389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.775449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.775739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.776012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] PATH_INFO: `/v3/services/network` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.776668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.778050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:38.792768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:38.793809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:38.794686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 353/717] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:38 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:38.800761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe29f8-a160-4997-be00-77d89983568b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.982280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:38.996541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe29f8-a160-4997-be00-77d89983568b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.033796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.034433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.034726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.035007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.035730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] RBAC: Adding query filter params (name=network) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:39.036044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.037440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628fab1-c827-4583-b5e8-3a81cd5b556a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.042944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 365/718] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:32:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:39.051467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.095459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:39.214898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cf772-4c80-49b4-be77-0252b20d2a5a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.260050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.260636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.260920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.261196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.261900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] RBAC: Adding query filter params (type=network) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:39.262204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.263593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3759d-e88e-42c5-8822-7eafca42472c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.269432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 354/719] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:39.461863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5d85-748c-42b4-8f66-93d3ec4e913f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.462431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5d85-748c-42b4-8f66-93d3ec4e913f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.462775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5d85-748c-42b4-8f66-93d3ec4e913f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.464664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 366/720] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:39.470516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.470933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.471396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.494305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:39.495529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:39.568355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 355/721] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:39.594012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db5d85-748c-42b4-8f66-93d3ec4e913f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.722179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db5d85-748c-42b4-8f66-93d3ec4e913f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.771970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.772827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.773111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.773436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.787816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:39.797556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:39.798488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:39.799595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 367/722] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:39.805027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.840470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:39.980842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81e779-6080-45a9-a8e1-b4f397748b12 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.031968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.032649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.032934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.033214 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.034216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:40.034744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.036125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.051053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 356/723] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:40.056335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.082560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.225187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9d23-eb27-4c61-9e97-33c4f35e7a13 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.259566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.260372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.260662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.260948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.272713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.274298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:40.292585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:40.293530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:40.294576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:40.294576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:40.294576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:40.294576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:40.294576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 368/724] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:40.303468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.405685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.431865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf4dc-e9bd-4756-9d30-1b81c209c99e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.466934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.467939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.468406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.468897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.469948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:40.470507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.473084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8860891-51a0-4558-8c7e-47365bd1dbc7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.486194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 357/725] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:40.491494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.598433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.651157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aebfb-843d-49f1-aca4-31791a039afd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.692057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd3fd-1820-4e1b-86f7-e460c9c196d4 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.692973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd3fd-1820-4e1b-86f7-e460c9c196d4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.693462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd3fd-1820-4e1b-86f7-e460c9c196d4 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.695336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 358/726] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:40.700658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.701204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.701775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.704594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.705549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.706132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.719578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.720107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:40.721074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.721880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:40.743008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:40.743989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:40.744951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:40.750842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 369/727] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:40.756533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.798601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 359/728] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:40.839105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.931103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dfce2-b9df-4797-ade4-7ac192086f2f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.966777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.973798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.992519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.993271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.993518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.993805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.994713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:40.995027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.996568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4d984-4ece-4099-90ca-00db03ba154c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.017237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de580-0d62-46e2-bba5-8bef353d8821 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.030165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 370/729] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:41.032137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683bc0-d500-4eef-a212-185fc602eb1e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.032608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683bc0-d500-4eef-a212-185fc602eb1e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.033040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683bc0-d500-4eef-a212-185fc602eb1e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.035710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 371/730] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:41.036783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683bc0-d500-4eef-a212-185fc602eb1e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.058686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55d8a3-8b99-4679-ab48-ce5541cc411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.059784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55d8a3-8b99-4679-ab48-ce5541cc411d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.060242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55d8a3-8b99-4679-ab48-ce5541cc411d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.060713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55d8a3-8b99-4679-ab48-ce5541cc411d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.072952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55d8a3-8b99-4679-ab48-ce5541cc411d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-cd55d8a3-8b99-4679-ab48-ce5541cc411d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:41.082565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:41.083506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:41.084321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:41.086819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 360/731] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:41.088282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.088715 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.089125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.111403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:41.113345 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:41.152769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683bc0-d500-4eef-a212-185fc602eb1e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.186243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 361/732] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:41.187417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.194622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.195636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.196107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.197118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.248896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.251222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.270306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.272012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.299809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598074-4eed-4349-a529-9887f78f6991 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.337420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.338095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.338533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.338819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.339636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:41.339955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.341450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5459bb-3ccb-4c9a-ba10-f9cc224c49d1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.354773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 362/733] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:41.354773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5bbf3-260d-4eb6-8a2c-4c71f16ee146 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.354773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5bbf3-260d-4eb6-8a2c-4c71f16ee146 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.354773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5bbf3-260d-4eb6-8a2c-4c71f16ee146 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.354773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 363/734] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:41.354773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5bbf3-260d-4eb6-8a2c-4c71f16ee146 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.383687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 372/735] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:41.384792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.470620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5bbf3-260d-4eb6-8a2c-4c71f16ee146 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.472921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.491410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.493623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183a9c-6917-4c00-bde6-5340d93e605b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.510277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b49d-e6dc-40d3-85e9-1135c23468e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.510910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b49d-e6dc-40d3-85e9-1135c23468e7 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.511188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b49d-e6dc-40d3-85e9-1135c23468e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.511471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b49d-e6dc-40d3-85e9-1135c23468e7 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.512196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b49d-e6dc-40d3-85e9-1135c23468e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.513571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b49d-e6dc-40d3-85e9-1135c23468e7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.532620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 364/736] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:32:41 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:41.534714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.535149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.535769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.549015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.551133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.551578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.552006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.555042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:41.556443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:41.567636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.569825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:41.594772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:41.596204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:41.597376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:41.597376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:41.597376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:41.597376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:41.601032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 373/737] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:41.602039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.644567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 365/738] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:41.645677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.762978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ce22b-f4e1-4139-b5b2-a34f0b012da0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.797409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.800710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34589576-8b74-46a8-9ac2-72bad84ec619 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.805898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.806060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.806422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.806827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.815458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.818601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.820311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:41.842690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:41.843878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:41.844999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:41.844999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:41.844999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:41.844999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:41.850444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 374/739] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:41.851498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.853802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.855021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.855474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.856856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.857757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:41.858216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.859884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.876457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 366/740] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:41.878242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.968666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8212d-4a69-4d58-bcee-fab6a05d0ebf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.007557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.008370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.008661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.008946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.013688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f09c4-488d-47d7-87eb-1c42348710af None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.020069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:42.028060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:42.029168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 375/741] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:42.030050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.056901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.057836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.058395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.058827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.059793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:42.060243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.062051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b055-7c73-44f7-8699-c3f6ca1d5293 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.075162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 367/742] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:42.076687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb37-001b-428c-991b-52380d13c1bf None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.076977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb37-001b-428c-991b-52380d13c1bf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.077537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb37-001b-428c-991b-52380d13c1bf None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.078835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 368/743] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:42.079918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bb37-001b-428c-991b-52380d13c1bf None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.080958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.109611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.143886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd571d01-3ccd-4985-9a2e-c47b62c546b0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.180000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.180814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.181096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.181370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.189428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.191205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.193176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bb37-001b-428c-991b-52380d13c1bf None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:42.206935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:42.207884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:42.208811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 376/744] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:42.209386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.237976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.238987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.239275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.239556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.240302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:42.240609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.241971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0626be7-ddc8-42ca-ae64-b0cac129b368 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.254885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 369/745] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:42.254885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.254885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.254885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.272663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:42.273784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:42.315501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc99558-882c-4736-aced-69d1beb43f18 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.317079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.346288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 370/746] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:42.347170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.368122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.375631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.376440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.376727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.377014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.384687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.386134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:42.401052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:42.402032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 377/747] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:42.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.456165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f286a-ed40-44f6-a4a0-c9bd93b43033 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.490611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.491285 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.491584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.491866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.492753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:42.493070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.494528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.512167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 371/748] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:42.512953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.522050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07111e-4a21-4d92-86c6-ad419a01de77 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.559336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.560178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.560452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.560727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.571142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.572593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:42.591917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:42.592877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:42.599449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:42.599449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:42.599449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:42.599449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:42.599449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 378/749] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:42.599449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.609522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.614616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.636050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2dd7-8413-4fa7-a8e3-c25313a3aae5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.678120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.681609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.681609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.681609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.681609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.681609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.696347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 372/750] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:32:42 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:42.707424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.711840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf7c8f-3aa6-4d6d-b08c-f4bc546490a6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.781022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.782444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.782742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.783392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.785362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:42.785690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.788126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.803390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 379/751] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:42.804267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.839272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897229d3-0fff-44ff-b1c5-262436297f85 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.877913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.878631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.878923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.879208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.885570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.891117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.924452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80248c7-0e60-4984-9570-72fd8344b39c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.960679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.962141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.965054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.965054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.965054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.965054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.965392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:42.965715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.970448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.084885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 373/752] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:32:43.084885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.125180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 380/753] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:43.126254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.133277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.213829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472135-0610-412c-bfa4-9fa4f54b470b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.233273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082e5e3-0738-467f-8195-40aa2f9c3041 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.260183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.261799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.262089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.262388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.263433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=b06c607bcb83464791b3c0b965bce133) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:43.263748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.265198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.272808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.276171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 374/754] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/role_assignments?user.id=b06c607bcb83464791b3c0b965bce133&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:43.280525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.281664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.282163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.282815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.283207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.297159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.299603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:43.323377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:43.324327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:43.325205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:43.325205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:43.325205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:43.325205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:43.328124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 381/755] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:43.337337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.470198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854dca8-3878-4664-8ef3-a1cf04a80ba0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.516134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.516816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.517105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.517386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.518323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:43.519062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.520443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.534389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 382/756] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:43.536943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d229f-46e4-4b09-ba50-2243f8245428 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.539276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.540414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.586091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.586956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.587245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.587490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.604904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.606395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.621509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:43.640450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:43.641543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:43.642510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:43.643519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 375/757] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:43.649698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.729995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642809f-a180-48a2-9044-df01c6f78b49 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.774802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.776273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.776558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.776833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.785686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.787184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-caa98695-d8d2-4167-9bb9-2f3f3792de45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:43.804726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:43.805679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:43.806604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 383/758] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:43.807574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730bf0-c740-4d11-8454-d9cfd1fde024 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.807737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730bf0-c740-4d11-8454-d9cfd1fde024 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.807987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730bf0-c740-4d11-8454-d9cfd1fde024 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.813355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 384/759] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:43.813712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406881d3-a841-4e25-b233-66a1efcfc12a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.814097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730bf0-c740-4d11-8454-d9cfd1fde024 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.864531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.867460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.868887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.870279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.872882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:43.874298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.878662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7efe0f-9af0-4155-a4b2-31e766e9556d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.924109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 376/760] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:43.927714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.928722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.929929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.939315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730bf0-c740-4d11-8454-d9cfd1fde024 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.940929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.967185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:43.969162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:43.984477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.985349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.985797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.987187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.988193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:43.988668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.990985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.995364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.005677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 385/761] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:44.006749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.092904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 377/762] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:44.095772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.155915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a6a5-c142-4f7d-92c3-c0d6ad777256 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.211810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.212977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.213282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.213561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.214974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5e78-58cc-469f-954c-7ba19a3bd8b4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.228460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.230184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.253080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:44.253848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:44.254742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:44.255643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:44.255643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:44.255643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:44.255643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:44.255643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 386/763] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:44.256371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.256859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.257350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.257821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.258892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=232b92d1afef4044bf608e629de2e966) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:44.259417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.261085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.267695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 378/764] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/role_assignments?user.id=232b92d1afef4044bf608e629de2e966&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:44.268828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.288370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.294893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.474599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51e54a-5c97-4887-ab2f-ec334c3b4e2f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.480668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81531f50-4262-4d30-851a-ffaf1659bb8e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.531753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.532947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.534705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.535362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.536790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:44.537668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.539814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.550692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.552162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.552666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.553134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.554012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.555699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.567684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 379/765] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:44.573243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:44.580711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:44.581628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:44.582483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:44.589819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 387/766] 10.222.0.64 () {56 vars in 1129 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:44.599369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.734896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db829-5a6f-48a7-bb8a-1d6ee8964a3e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.738733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.744500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.781124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce1d7-d289-4e89-9d02-14a3b7a45ebd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.824198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.824918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.825213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.825502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.826599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.827272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.827563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.827840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.828561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:44.828874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.833294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.834947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.836961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.848392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 388/767] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:44.854165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:44.866025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:44.867262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:44.872866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 380/768] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:44.878209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.055008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2df0-da2c-42d0-b0cd-36da3b893c66 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.074288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce7a1c-93e3-4981-aee3-a2219fc8666b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.110960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.111698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.111979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.112255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.113193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:45.113502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.114916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.121551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.122548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.123041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.123521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.123773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 389/769] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:45.124886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:45.125407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.127086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.135671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.146124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.146730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.147353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 381/770] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:45.149411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.260150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ffbd3-90c0-49b3-a055-80385a242717 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.296755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.297414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.297695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.297972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.298833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] RBAC: Adding query filter params (interface=public, service_id=835532c0d4034ad3a01ffc12b645eb65, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:45.299833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.301287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2c382-12d7-4ad9-a1eb-2e96f3c31195 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.313432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 390/771] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/endpoints?service_id=835532c0d4034ad3a01ffc12b645eb65&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:45.314961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eea41a-8a36-4106-a350-b42c03dd3978 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.315277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eea41a-8a36-4106-a350-b42c03dd3978 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.315558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eea41a-8a36-4106-a350-b42c03dd3978 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.317265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 391/772] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:45.317771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eea41a-8a36-4106-a350-b42c03dd3978 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.388453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac61b3-69a3-4f22-bc26-bcaa78d1c01b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.394171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.427068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eea41a-8a36-4106-a350-b42c03dd3978 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.429941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46409613-deb3-4821-ba02-9e6dd43c94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.431446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46409613-deb3-4821-ba02-9e6dd43c94b8 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.432288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46409613-deb3-4821-ba02-9e6dd43c94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.432828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46409613-deb3-4821-ba02-9e6dd43c94b8 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/a3981687a6c741afbd3d22eb49fe4da7/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.435313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46409613-deb3-4821-ba02-9e6dd43c94b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=a3981687a6c741afbd3d22eb49fe4da7, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.437243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46409613-deb3-4821-ba02-9e6dd43c94b8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.462601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 382/773] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:45 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/a3981687a6c741afbd3d22eb49fe4da7/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:45.462601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.462601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.462601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.491439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7d04-fb4e-47a7-9839-c7fd519c45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.492179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7d04-fb4e-47a7-9839-c7fd519c45e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.492466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7d04-fb4e-47a7-9839-c7fd519c45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.492737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7d04-fb4e-47a7-9839-c7fd519c45e5 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.493781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7d04-fb4e-47a7-9839-c7fd519c45e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.496639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7d04-fb4e-47a7-9839-c7fd519c45e5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.500991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:45.504451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.509642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 392/774] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:45.596601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.616819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ee8d-6d07-4c51-bdc1-6f2c11fd4648 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.617389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ee8d-6d07-4c51-bdc1-6f2c11fd4648 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.617389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ee8d-6d07-4c51-bdc1-6f2c11fd4648 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.619147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 393/775] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:45.625102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.625393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.625837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.634695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 383/776] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:45.654469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:45.655725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.688143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.770378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 394/777] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:45.794506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.821528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643f762-c0fc-4f54-bd78-9050e6bbcf5d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.860206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.861434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.862016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.862708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] PATH_INFO: `/v3/services/network` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.863662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.865325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.867604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:45.880257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:45.881681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:45.882596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:45.887000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 384/778] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:45.893105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.910708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5626a-ab69-4282-8e8a-04d3542f348c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.952102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.984227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.985044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.985347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.985626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.013120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfece3e-a530-469a-9dbe-4969cfad8ca7 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.015279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:46.023761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:46.024804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:46.025913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:46.034859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 395/779] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:46.040588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.062623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.063679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.064186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.066566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.067531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:46.068050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.070750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.088154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 385/780] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:46.093113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.232635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c76163-364a-4b2b-954a-b861cf6ae626 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.275987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:46.280320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dac46-1eb9-4045-bc5b-4b9fc13695c9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.297319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:46.303043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.304007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.304515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.305058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.306016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:46.306555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.308119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.321219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.321952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.322302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.322642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.323430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] RBAC: Adding query filter params (type=network) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:46.323671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.325056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.326479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 396/781] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:46.331500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 386/782] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:46.332509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.337631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.508033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dab68d-681b-426d-8fbf-a2e24cd516f2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.527223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8d266-af6b-4037-8c68-9cbd58bbda8d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.571004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.572625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.572909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.573189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.590745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.591415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.591711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.591987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.592792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] RBAC: Adding query filter params (interface=public, service_id=24e67834c8ff48a4965962af0d1345f2, region_id=RegionOne) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:46.593113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.594514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.599924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.601380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.615354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 387/783] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/endpoints?service_id=24e67834c8ff48a4965962af0d1345f2&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:46.620883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:46.634571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:46.635781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:46.636674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:46.636674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:46.636674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:46.636674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:46.636674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 397/784] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:46.641301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.676732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:46.688379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:46.755177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c587a-cf26-4030-869f-205e8cccb69d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.772228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127c5e-90c7-42c7-a4b6-9d9442dd071c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.792662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.793688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.794170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.794666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.795586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:46.796091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.797668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a7b3b-a4bd-462e-a1c8-76a8991c7dd1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.810786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 398/785] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:46.812371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476b22a-5415-44ef-946d-be82bc23f604 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.812880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476b22a-5415-44ef-946d-be82bc23f604 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.813353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476b22a-5415-44ef-946d-be82bc23f604 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.819926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505b226-f279-433b-bca1-9cc040686c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.819926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505b226-f279-433b-bca1-9cc040686c02 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.819926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505b226-f279-433b-bca1-9cc040686c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.819926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505b226-f279-433b-bca1-9cc040686c02 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.820294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505b226-f279-433b-bca1-9cc040686c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.820294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505b226-f279-433b-bca1-9cc040686c02 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.820794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 399/786] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:46.821795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476b22a-5415-44ef-946d-be82bc23f604 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.830410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 388/787] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:46.830410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364188-c36a-4235-b6c5-9162727c213d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.830410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364188-c36a-4235-b6c5-9162727c213d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.830410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364188-c36a-4235-b6c5-9162727c213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.857375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-94364188-c36a-4235-b6c5-9162727c213d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:46.861415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-94364188-c36a-4235-b6c5-9162727c213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:47.007825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.013776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 389/788] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:47.018382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476b22a-5415-44ef-946d-be82bc23f604 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.048565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94364188-c36a-4235-b6c5-9162727c213d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.053859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.054680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.055063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.055437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.065748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.067360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:47.084600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:47.085586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:47.087054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 400/789] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:47.092211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.094644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.191634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94364188-c36a-4235-b6c5-9162727c213d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.222704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10fda0-84ab-4389-bcdd-699958ec7858 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.240029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.241243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.241631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.242071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.259856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:47.263124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.263968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.264403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.264830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.265913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:47.266403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.268600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:47.269772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:47.270841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:47.271661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:47.273002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 390/790] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:47.279278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.296110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 401/791] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:47.303530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.338259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.457304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.466874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0da5-aefb-4664-9726-acdf9b4d40dc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.501147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00315f7b-bca0-4dd5-be64-be59b4821e92 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.503972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.504705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.504992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.505328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.506089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:47.506492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.508050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.528259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 391/792] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:47.535937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.540555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.541357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.541638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.541912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.553056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.554601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:47.573204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:47.574129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:47.575242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:47.575242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:47.575242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:47.575242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:47.575242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 402/793] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:47.581896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.698915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248e4f9-6eee-4361-a7ff-3d97e1846dca None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.719560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.734313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.735223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.735511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.735788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.755204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.756668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.789134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e902-d417-4525-81a6-d5ad63d5d9b4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:47.793077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:47.793966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:47.795233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:47.795233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:47.795233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:47.795233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:47.795233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 392/794] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:47.806206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.824885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.861857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.862558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.862847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.863130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.863866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:47.864181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.865564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.882383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 403/795] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:47.883575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.959095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0af4e0-270a-4ee3-abd0-d0a41c94624e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.025630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9d45e-69b8-4bb4-836e-9ba2f73e1441 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.027225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.028003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.028298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.028584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.029328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:48.029641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.031043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babfa4c-681a-42de-a925-18f1d3b86af7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.050349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 393/796] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:48.051878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37b8a-8687-4ca1-8bcf-4000a6690c1d None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.052180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37b8a-8687-4ca1-8bcf-4000a6690c1d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.052461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37b8a-8687-4ca1-8bcf-4000a6690c1d None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.053775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.059237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 394/797] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:48.060010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd37b8a-8687-4ca1-8bcf-4000a6690c1d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.063643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.064456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.065279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.065559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.072875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.074501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-423d3c1c-2f90-47c2-a4b1-38299c69dcd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:48.090694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:48.091762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:48.092842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:48.093697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 404/798] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:48.095102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfbba-4b4e-44b9-bd2c-70e7dada7876 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.095468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfbba-4b4e-44b9-bd2c-70e7dada7876 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.095870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfbba-4b4e-44b9-bd2c-70e7dada7876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.114386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-626dfbba-4b4e-44b9-bd2c-70e7dada7876 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:48.115590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-626dfbba-4b4e-44b9-bd2c-70e7dada7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:48.138780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.184862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd37b8a-8687-4ca1-8bcf-4000a6690c1d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.189648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 405/799] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:48.191011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cbc0d-5184-4081-95eb-662be88704ed None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.191299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cbc0d-5184-4081-95eb-662be88704ed None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.191573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cbc0d-5184-4081-95eb-662be88704ed None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.192968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 406/800] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:48.197441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cbc0d-5184-4081-95eb-662be88704ed None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.231733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.232550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.232842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.233127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.240686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.242135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8bf71965-abf2-43cc-8cc5-63c151e737d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:48.262576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:48.263568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:48.264497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:48.269507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 395/801] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:48.270931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.271289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.271506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.290407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:48.291605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:48.318756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cbc0d-5184-4081-95eb-662be88704ed None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.338026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.357590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.358268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.358585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.358870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.359730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:48.360052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.361586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.370772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 396/802] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:48.372089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.373698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 407/803] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:48.379638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.442406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.485054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf16f-c9fe-4276-9aed-579b5b18729e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.490177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512efcf-9a90-47d4-95b1-9bedf6817149 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.522469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.523264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.523623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.523978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.524828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:48.525145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.526870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.526974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.527900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.528268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.528556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.539508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:48.549493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 408/804] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:48.549493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:48.549707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:48.550642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 397/805] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:48.551462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.590342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.660479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e35acd-d976-4fdd-b95d-51b67ba5a5b3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.662879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cb744-c0bb-4066-86db-0d5f0a62c4f9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.690501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.699622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.700519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.700805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.701088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/b06c607bcb83464791b3c0b965bce133/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.703267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=b06c607bcb83464791b3c0b965bce133, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.705051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.706127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.706969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.707258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.707537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.708191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.709560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.726309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 409/806] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:48 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/b06c607bcb83464791b3c0b965bce133/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:48.726309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:48.726935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:48.727821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:48.728670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 398/807] 10.222.0.64 () {56 vars in 1129 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:48.729512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.861175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bb1b-1ca2-4a28-b985-60b818d87782 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.868276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.874729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd8909-8eaa-4849-8cda-e79dec081f66 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.907318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.907994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.908319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.908612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.909374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:48.909677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.911799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.914766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.915641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.915887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.916163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.920896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 399/808] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:48.921623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.927858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.929325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:48.948631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:48.949581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:48.950578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:48.950578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:48.950578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:48.950578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:48.950578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 410/809] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:48.955087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.970066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.028526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9656-3c7a-4128-85d0-1081ecf31b06 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.061478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b92df-54c5-41b3-aaad-b3932992683e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.063850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.064569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.065069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.065428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.066147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:49.066506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.067897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.073129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 400/810] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:49.073928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.097739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.098628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.098915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.099202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.109948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.112003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.121125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:49.132128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:49.134205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:49.136377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:49.136377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:49.136377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:49.136377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:49.136377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 411/811] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:49.136377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.185202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83ada-74ed-4551-b161-656246c3bf52 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.194626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.222959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.223630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.223915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.224196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.224924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:49.225233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.226636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.240608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 401/812] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:49.241444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.248401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c881d-29cf-4371-9f74-edfeda3aa111 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.286619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.287224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.287540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.287828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.288712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:49.289029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.290710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.296405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 412/813] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:49.297163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.349816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8ba9-b37a-4551-a7be-39726941169f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.363657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.385648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.386306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.386628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.386913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.387629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:49.387936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.389298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.401096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 402/814] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:49.401874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.409719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916851-9f2a-4e9a-a109-91e80107f926 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.433664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.452489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.454128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.454595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.455025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.464084 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.466453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9cc1261d-8bef-41ee-a9e6-6b46e74e64d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:49.486039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:49.487901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:49.488991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:49.492791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 413/815] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:49.494258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971b28-dc13-4815-923f-6c1bcd7470fe None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.494585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971b28-dc13-4815-923f-6c1bcd7470fe None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.494881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971b28-dc13-4815-923f-6c1bcd7470fe None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.500383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 414/816] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:49.501053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90971b28-dc13-4815-923f-6c1bcd7470fe None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.515000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4df8-661a-475a-aee2-4af0a418acce None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.551860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.552589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.552880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.553184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.553945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.555351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.578203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 403/817] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:32:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:49.579916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.621637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90971b28-dc13-4815-923f-6c1bcd7470fe None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.646402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.668461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.669532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.670006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.670458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.680893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.682693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-94980596-97d6-43a8-bb35-f9073fe4079b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:49.705857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:49.707102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:32:49.708299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:49.715479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 415/818] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:49.718499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526ab68-3037-4094-a65e-db5335953106 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.718843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526ab68-3037-4094-a65e-db5335953106 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.719134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526ab68-3037-4094-a65e-db5335953106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.735613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.743583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9526ab68-3037-4094-a65e-db5335953106 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:49.744885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9526ab68-3037-4094-a65e-db5335953106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:49.765932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543bbc0-d84c-4640-ae2c-d4ce2da6fd5e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.808847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.809922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.810504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.810936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.811886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:49.812358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.813800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.824135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 416/819] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:49.825349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526ab68-3037-4094-a65e-db5335953106 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.829939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 404/820] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:49.837373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.960774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526ab68-3037-4094-a65e-db5335953106 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.970927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660149aa-60f2-46af-9e05-b35bef3b2f85 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.978700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.999403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.000427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.000910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.001408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.002629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:50.003145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.004799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.017388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.019147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.019437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.019719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/232b92d1afef4044bf608e629de2e966/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.025866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 417/821] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:50.026979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.044536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=232b92d1afef4044bf608e629de2e966, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.046668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.049912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.065542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 405/822] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:32:49 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/232b92d1afef4044bf608e629de2e966/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:50.066889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.222621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b798-e06e-4ba4-b7e5-ab383bcef8e1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.269313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb32d44-b7d1-4bf3-9fd9-05b532cb9d08 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.281064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.281880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.282168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.282484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] PATH_INFO: `/v3/services/network` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.283155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.285696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:50.298211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:50.300143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:32:50.300969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:50.304943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 418/823] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:50.306231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.316564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.317514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.317992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.318534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.340157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.385131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.393612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.396006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.418259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9044c-ba3b-48aa-ac4d-d77dcd237732 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.455784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.456770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.457205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.457631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.458526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:50.458978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.460533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.469472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 419/824] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:50.472098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.503405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 406/825] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:32:50.509020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.581173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.589081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b93ee-c88c-45fd-a350-f25b8063f9e0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.607894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.616497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e819d0-2b16-4697-924b-667df075c3b9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.626175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.627073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.627368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.627655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.628378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] RBAC: Adding query filter params (type=network) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:50.628689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.630097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.640002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 420/826] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:50.641388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.654640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.655664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.656111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.656545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.668378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.670034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:50.689358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:50.691000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:50.691961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:50.691961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:50.691961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:50.691961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:50.694271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 407/827] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:50.699800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.751097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b359a8-e1f1-4264-9dff-382994a31132 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.787941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.788528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.788820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.789102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.789866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.791295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.807508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205449-2038-4335-aedf-f39b61fda16c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.828372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 421/828] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:32:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:50.858905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.859839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.860299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.860717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.862202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:50.862680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.864237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf4222-dfe1-4690-b62d-15cfbca30948 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.878255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 408/829] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:50.884182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.914520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.956170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cf2a-f3fa-4619-9a59-0472dcbcb18b None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.956456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cf2a-f3fa-4619-9a59-0472dcbcb18b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.956737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cf2a-f3fa-4619-9a59-0472dcbcb18b None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.958459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 409/830] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:50.963671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.963953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.964230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.969496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.986899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:50.988401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:51.061314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38a6e0-7fe1-4882-a152-42db689c00b0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.066680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 410/831] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:51.091116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.102953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.103597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.103886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.104169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.111832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.113727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:51.133131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:51.134235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:51.135363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 422/832] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:51.144660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.215943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a57d-ea81-4be6-a0a2-2e7f70fba26e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.237202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.249161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.256935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.258092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.258616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.259093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.264782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068406f9-e1be-4ead-a9f7-f6bd067447b7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.271910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:51.280251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:51.281186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:32:51.282039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:51.285040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 411/833] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:51.290831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.304517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.305364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.305581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.305872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.308036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:51.308147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.309648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.324792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 423/834] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:51.336627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.418161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788984b4-5f13-43fb-aba2-af64a7c8c0b8 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.463959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.464800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.465428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.465814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.467012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:51.467327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.468699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.473961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85877e78-fdda-429c-8d8e-548723b5ca7a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.482973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 412/835] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:51.490390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.512269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.513159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.513590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.514009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.515069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=a3981687a6c741afbd3d22eb49fe4da7) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:51.515548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.517142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.521607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.525899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 424/836] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/role_assignments?user.id=a3981687a6c741afbd3d22eb49fe4da7&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:51.561040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.616944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3f411-bb30-4a4d-a4ff-8f55284ce89d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.655863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.656682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.656970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.657253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.676427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.677911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:51.702678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:51.703596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:51.704465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:51.704465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:51.704465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:51.704465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:51.704465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 413/837] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:51.710270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.818967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab7a50-f5c2-4507-9298-cf6b28808dd0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.854043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.854745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.855036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.855314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.856102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:51.856412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.857828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.870733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 425/838] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:51.876258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.982686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8ef80-a0ed-4e27-916b-87de437701a9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.990831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.020094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.020899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.021189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.021468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.029227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.030724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-0b5532d1-c2ec-468a-8418-217fd5f1db3a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:52.045266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:52.048083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:52.054694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 414/839] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:52.055283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.077839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91545e-6c80-44c6-9f4f-eeb5d7270e1b None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.078806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91545e-6c80-44c6-9f4f-eeb5d7270e1b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.079335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91545e-6c80-44c6-9f4f-eeb5d7270e1b None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.081914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 415/840] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:52.087394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.087961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.088450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.108573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:52.110269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:52.130841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.190392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bf319-e2e5-49ea-aa9f-740a180b964b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.191065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 416/841] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:32:52.209275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.227437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.228373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.228669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.228954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.230209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:52.230576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.232014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.258125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 426/842] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:52.263201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.326274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.336304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ae968-a31e-423d-985a-a60088fc6542 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.373620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.374480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.374768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.375047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.375760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.378201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:52.396843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:52.398076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:32:52.399111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:52.402663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 417/843] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:52.408693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.409776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f71f82-2b6b-455b-8b41-360f606878f3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.433657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.457510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ec034-c208-4699-8a28-d2326521063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.458172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec034-c208-4699-8a28-d2326521063b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.458493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec034-c208-4699-8a28-d2326521063b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.458811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec034-c208-4699-8a28-d2326521063b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.523579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6bdbf-47cb-4a61-9be3-1bae3b7d1bf7 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.554333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ec034-c208-4699-8a28-d2326521063b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.556318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ec034-c208-4699-8a28-d2326521063b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.562882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.563789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.564277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.565467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.566578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:52.567095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.568749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.576729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 418/844] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:52.581287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.609505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.686561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 427/845] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:32:52.686561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0c3f4-5632-4293-8458-55aeab545658 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.686561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0c3f4-5632-4293-8458-55aeab545658 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.686561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0c3f4-5632-4293-8458-55aeab545658 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.686561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 428/846] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:52.689836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0c3f4-5632-4293-8458-55aeab545658 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.709479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.718661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488fa11-8558-4be5-8618-8ae756b66980 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.755282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.755954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.756248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.756537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.757255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:52.757570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.758978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a085e-40b8-48a1-8a3d-51c70dd8295f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.770399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 419/847] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:52.770399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.770399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.770399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.794600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:52.795905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:52.812408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0c3f4-5632-4293-8458-55aeab545658 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.853125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.853968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.854228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.854556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.868823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.870313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.889795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 420/848] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:52.898064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:52.899012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:52.899876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:52.899876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:52.899876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:52.899876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:52.902414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 429/849] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:52.910388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.914007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.930636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.997480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.029806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc1b7-cf3c-4a72-8a97-af19a9e8cc29 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.030580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558be54-289e-46ce-8e9e-8452e9e8bb20 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.065430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.066652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.067136 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.067242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.067723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.067840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.068125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.068412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.069139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:53.069455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.070963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.079836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:53.088121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 421/850] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:53.089015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:53.089595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:53.090551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:32:53.091598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:53.094143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 430/851] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:53.106615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.174764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.199396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d98e-a81c-493d-b679-7f485947da6d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.217252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1bf6f-fb17-4a71-bde7-1e4722023a6b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.238174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.239015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.239303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.239586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.247150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.248672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.249747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.257545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.258536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.260523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.261023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.261977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:53.262528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.264091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:53.267448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:53.268702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:53.269594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 422/852] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:53.276088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.277225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 431/853] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:53.283191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.394806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bb466-7e0b-4e59-b351-051bc65fb136 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.401179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0efc-e76c-4045-8cf7-c2232dc7db4b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.435127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.436088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.436432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.436717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.444975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.446031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.446537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.447102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.448084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:53.448582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.449180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.450480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.450692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.458491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.465904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 423/854] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:53.475360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:53.476030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:53.476886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:53.477776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:53.477776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:53.477776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:53.477776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:53.485249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 432/855] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:53.486849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.546599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.604096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35438-3327-4303-8a79-f0f9a4c0765e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.623827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241ad9-289a-4ac3-aca0-39c58ed41878 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.647298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.647965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.648254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.648542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.649385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=b06c607bcb83464791b3c0b965bce133) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:53.649705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.651871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.660055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 424/856] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/role_assignments?user.id=b06c607bcb83464791b3c0b965bce133&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:53.673560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.675471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.675978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.676470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.677475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:53.678007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.679763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770fbf-d2f5-43b1-9e01-5be8f3cc5312 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.695375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 433/857] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:53.703533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.751630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9184bc-6e2f-4963-9d73-c23aea5b38b7 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.752050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9184bc-6e2f-4963-9d73-c23aea5b38b7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.752398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9184bc-6e2f-4963-9d73-c23aea5b38b7 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.755079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 434/858] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:53.760840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ff79-c464-4380-8270-f95064aff10c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.761144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ff79-c464-4380-8270-f95064aff10c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.761408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ff79-c464-4380-8270-f95064aff10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.781131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.785921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e584ff79-c464-4380-8270-f95064aff10c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:53.787487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e584ff79-c464-4380-8270-f95064aff10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:53.825652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a358961-1222-493b-9633-aac5bd1641bf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.868152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.869289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.869580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.869858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.874062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 435/859] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:32:53.879676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.881107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.896265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ff79-c464-4380-8270-f95064aff10c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:53.896763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:53.897678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:53.899044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 425/860] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:53.904028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.933139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.020218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ff79-c464-4380-8270-f95064aff10c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.032403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258e58-8c12-4e06-9430-3d3bd79f705a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.056273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.061391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.062528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.063631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.065094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.065997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.067593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.068998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.069679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.069960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.070374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.071224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:54.071806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.073009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:54.083299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:54.084326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:32:54.085155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:54.088285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 436/861] 10.222.0.64 () {56 vars in 1132 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:54.096410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 426/862] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 19 15:32:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:54.096918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.101094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.228176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.232320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4609ac-e08b-4cda-b833-9d630795c50f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.234109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883174-a5be-4639-a4f7-c1b5b61ff790 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.269039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.269855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.270240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.270761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.271816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:54.272074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.273604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.281611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.282620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.283113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.283645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.284387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 437/863] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:54.285263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.352742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.380118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.381950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.403117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607ae40-d667-4edf-a9a9-32c247b275c0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.450457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.451736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.452250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.452758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.453946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:54.455582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.457468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.464194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 438/864] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:54.498472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 427/865] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:32:54.507541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.558750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.633707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e1a9e-33b7-466a-91cd-e5b2fa3466d1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.671316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.672469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.672987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.673468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.690555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.692297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:54.716190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:54.717131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:54.718014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:54.718014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:54.718014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:54.718014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:54.718014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 439/866] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:54.723714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.807455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.828476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f6124-c7b7-4294-9949-5b8496ba470a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.864679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.865362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.865651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.865935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.866702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:54.867017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.868399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e54cc-96e1-4d70-b7c6-96ae8eae7da0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.880705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 428/867] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:54.887097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.959848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720026-a946-4d3d-80df-ea1f305629d8 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.960176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720026-a946-4d3d-80df-ea1f305629d8 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.960420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720026-a946-4d3d-80df-ea1f305629d8 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.961944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 429/868] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:54.967288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.967841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.968316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.986018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:54.988308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:54.995067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:55.029466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666db421-ab09-4e30-8793-1dd393bb21bf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.066424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.067228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.067515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.067793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.074843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.076289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.088187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 430/869] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:32:55.092121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:55.093044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:55.094006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 440/870] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:55.098986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.114873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.176209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:55.211804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254e653-0055-48c8-a4c1-49e5659bfa48 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.240404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32d2a-540c-4c93-a253-5467450c8c15 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.258692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.259777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.260276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.260761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.261845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:55.262510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.264781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.280457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 431/871] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:32:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:55.282239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d60040-1e38-4c7a-9b80-b7d3bdefde23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.282944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d60040-1e38-4c7a-9b80-b7d3bdefde23 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.283360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d60040-1e38-4c7a-9b80-b7d3bdefde23 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.283710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d60040-1e38-4c7a-9b80-b7d3bdefde23 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.284481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d60040-1e38-4c7a-9b80-b7d3bdefde23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.285894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.286153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d60040-1e38-4c7a-9b80-b7d3bdefde23 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.297539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:55.314433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 441/872] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:32:55 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:32:55.415283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465042e0-5f0c-477f-ac51-1733824f6beb None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.451252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:55.464374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.465414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.465904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.466412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.467501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=232b92d1afef4044bf608e629de2e966) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:55.468031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.469873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f13d84-e9f4-43a7-b928-3df3ffe98e9c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.478191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 432/873] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:32:55 2022] GET /identity/v3/role_assignments?user.id=232b92d1afef4044bf608e629de2e966&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:55.878440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b0373-5d96-425e-a446-85a78821fbf7 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.879006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b0373-5d96-425e-a446-85a78821fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.879442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b0373-5d96-425e-a446-85a78821fbf7 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.881034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 442/874] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:55.886649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba4711-543b-46fa-b027-993200cf828b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.887209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba4711-543b-46fa-b027-993200cf828b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.887693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba4711-543b-46fa-b027-993200cf828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.906116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-08ba4711-543b-46fa-b027-993200cf828b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:55.907657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-08ba4711-543b-46fa-b027-993200cf828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.978599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 433/875] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:56.000540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b0373-5d96-425e-a446-85a78821fbf7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.114605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b0373-5d96-425e-a446-85a78821fbf7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.151150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.151875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.152158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.152430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.153081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:56.154461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:56.167958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:56.169017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:56.169871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 443/876] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:32:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:56.177331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba4711-543b-46fa-b027-993200cf828b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.282787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba4711-543b-46fa-b027-993200cf828b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.304528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:56.319538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.320316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.320607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.320888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.321603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:56.321910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:56.323300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28782b-a2a6-4759-a4fc-e05da70ccb46 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:56.328418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 434/877] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:32:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:56.336292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.402194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:56.448669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865009-71a0-4ea9-a43f-e1d462bdc64e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.484819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.485496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.485777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.486053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.487388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:56.487696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:56.489069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768c9a-f87f-43a5-a44a-352b1fdb5925 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:56.494472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 444/878] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:32:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:56.647003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b2c7-1c8a-47b3-a2c8-6ca99248cd6f None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.647354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b2c7-1c8a-47b3-a2c8-6ca99248cd6f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.647579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b2c7-1c8a-47b3-a2c8-6ca99248cd6f None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.649224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 435/879] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:56.655095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dce8ea-63d3-4360-a984-d46744e8d053 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.655288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dce8ea-63d3-4360-a984-d46744e8d053 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.655562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dce8ea-63d3-4360-a984-d46744e8d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.675867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f1dce8ea-63d3-4360-a984-d46744e8d053 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:56.677397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f1dce8ea-63d3-4360-a984-d46744e8d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.752721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 445/880] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:56.775998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b2c7-1c8a-47b3-a2c8-6ca99248cd6f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.884330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b2c7-1c8a-47b3-a2c8-6ca99248cd6f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.920106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7e26e-1deb-4ed2-9dbd-7a7752e283c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.920699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7e26e-1deb-4ed2-9dbd-7a7752e283c2 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.920987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7e26e-1deb-4ed2-9dbd-7a7752e283c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.921270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7e26e-1deb-4ed2-9dbd-7a7752e283c2 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.922004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7e26e-1deb-4ed2-9dbd-7a7752e283c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:56.923415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7e26e-1deb-4ed2-9dbd-7a7752e283c2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:56.942322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 436/881] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:32:56 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:57.558012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac6ec-fa2b-4c89-9944-ad498414774f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.558565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac6ec-fa2b-4c89-9944-ad498414774f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.558666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac6ec-fa2b-4c89-9944-ad498414774f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.560214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 446/882] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:57.565692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.566128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.566305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.584013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:57.585223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:57.632308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:57.673619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 437/883] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:57.692833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac6ec-fa2b-4c89-9944-ad498414774f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.759657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:57.808399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac6ec-fa2b-4c89-9944-ad498414774f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.844044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.845197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.846304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.846867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.847730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.849309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a15a710c-834d-4e69-8cfb-71402d4c42eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:57.861684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:57.862745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:32:57.863589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:57.866466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 447/884] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:57.875464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.978708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9a86-7366-493a-958e-61480cb25b5a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.982208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaf28b-f150-4382-bec0-2298720cc55b None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.982760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaf28b-f150-4382-bec0-2298720cc55b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.983251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaf28b-f150-4382-bec0-2298720cc55b None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.986095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 448/885] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:57.990842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.991381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.991883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.008740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:58.010227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.015486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.016163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.016457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.016745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.017459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:58.018312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.019719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.024932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 438/886] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:58.030708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.066057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.090460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 449/887] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:32:58.109400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.134752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af7e2-12e2-4693-bea9-451380680376 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.166720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.172581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.173264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.174473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.174473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.175198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:58.175684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.177220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.186530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 439/888] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:58.189036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.219743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c6b6-76b2-47e2-ac56-8e48fa2125b3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.257899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.259178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.259694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.260325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.273282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:32:58.282725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:58.284284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:32:58.285113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:58.292582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 450/889] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:58.294064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.304442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.308985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a266d-c0a2-4354-8841-20606216bf47 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.357185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.357896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.358193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.358503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.359464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] RBAC: Adding query filter params (interface=public, service_id=7b7c2886825a4a0ba7a671da35c6618c, region_id=RegionOne) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:58.359788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.361674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.370444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 440/890] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/endpoints?service_id=7b7c2886825a4a0ba7a671da35c6618c&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:58.374683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.438035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b7352-a1a3-4299-9cb9-d637fde7bc82 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.449631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.477381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.478520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.479038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.479543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.480505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:58.481018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.482641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.489299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f894d-4c00-498b-8e92-6c4a48e91459 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.496730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 451/891] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:58.498501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.527433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cef8bf-bc89-43bc-866b-e46aae45892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.528108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef8bf-bc89-43bc-866b-e46aae45892e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.528394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef8bf-bc89-43bc-866b-e46aae45892e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.528674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef8bf-bc89-43bc-866b-e46aae45892e None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.529431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef8bf-bc89-43bc-866b-e46aae45892e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.530755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef8bf-bc89-43bc-866b-e46aae45892e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.546813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 441/892] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:32:58.618726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c18bc4-4925-4306-8e6d-80278a48ca7c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.635590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22b05-adea-4dcf-a8bd-1868001f5b34 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.636129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22b05-adea-4dcf-a8bd-1868001f5b34 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.636129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22b05-adea-4dcf-a8bd-1868001f5b34 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.637640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 442/893] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:32:58.643816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.644488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.645216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.660766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.661686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.661979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.662320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.665735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:58.667288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.687315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.688794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.692553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:58.709207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:58.710190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:58.711139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:58.711139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:58.711139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:58.711139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:58.715228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 452/894] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:58.716448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.744095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.754126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 443/895] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:32:58.779480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.834506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ff75-17e5-40c3-bb18-b046d1d24d61 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.876218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.876835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.877129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.877412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.878350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:58.878696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.880074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.894790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ea2c-cd23-4ec6-a989-09b125cd0b4e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.897728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 453/896] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:58.899239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.933028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.933708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.933999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.934282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.935050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.936444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.958525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 444/897] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:58.996063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.014771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09ed8-af90-48d0-8715-1c1f30b3c9a2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.061609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.062560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.062850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.063129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.071559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.073042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-31fa9298-5e83-419a-9e9c-91e5307406b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:32:59.090381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:59.091393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:59.092835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 454/898] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:59.100629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.126014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.202476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398939-7d85-4190-8d0f-2ee57d875ce2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.202794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398939-7d85-4190-8d0f-2ee57d875ce2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.202961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398939-7d85-4190-8d0f-2ee57d875ce2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.204481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 455/899] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:59.210525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.211183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.211671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.227730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5b63-c900-4232-a44e-64eac533e9db None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.230468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:59.231765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.269256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.270517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.271071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.271402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.272276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:59.272595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.274523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.302436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 445/900] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:59.304667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.322385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 456/901] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:32:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:32:59.339596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.397469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.422779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.428032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6370587-3a59-44b7-a695-7c0dbae90ae9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.469758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9ae00-3e56-4238-9a1c-d36afd028004 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.473408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.474343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.474920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.475393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.516893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.517797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.518072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.518380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.519590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.521048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:59.538722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:59.539835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:32:59.540673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 457/902] 10.222.0.64 () {56 vars in 1132 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:32:59.547011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.558493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.560200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.641677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.665517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a86be7-44f8-445b-b92e-defd5e53944f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.672649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 446/903] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:32:59.681817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.713648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.714617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.715074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.715496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.716369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:59.716844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.718398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.719733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.725442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 458/904] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:59.731129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.813547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49d0b0-ae15-4173-8e42-69f06059f2d5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.841687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246797f-162f-43ac-aa64-ae34e90a96e7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.851700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.852749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.853133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.853508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.865230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.866855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.880954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.881829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.882302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.882806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.883703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:59.884176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.885701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:32:59.887337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:32:59.888349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:32:59.889270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:32:59.889270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:32:59.889270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:32:59.889270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:32:59.889572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 447/905] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:32:59.894036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 459/906] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:32:59.899423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.901007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.936510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.968475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.013260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39623a-bd0c-4f3d-ba41-f2c448fcc102 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.036077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18ea5-719b-4814-9258-b7b90d78d319 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.055861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.057228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.057713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.058185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.059731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] RBAC: Adding query filter params (interface=public, service_id=b69cf09a4fe54123bc9447ffa9845cfc, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:00.060525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.062753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.071174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 460/907] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/endpoints?service_id=b69cf09a4fe54123bc9447ffa9845cfc&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:00.078088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.079161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.079816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.080736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.080951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.081658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:00.081972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.083452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.100682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 448/908] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:00.101997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.187890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f59cf-46f5-492f-b979-f8199c6c007a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.192944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.210731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dc1e7-d285-4091-8cce-8b6d0e797afe None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.217641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.229377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.230496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.230984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.231461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.232396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.234055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.242012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 461/909] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:00.258835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.260073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.260579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.261138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.269876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.272028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:00.289725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:00.290748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:00.291667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:00.294450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 449/910] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:00.300767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.419960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002a014-f4d6-4e84-a832-5c678998be0a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.459526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.460223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.460490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.460772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.461570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:00.461887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.463371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb318-f671-4901-a1aa-7a9a99c07999 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.481071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 462/911] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:00.482622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.591736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59d15-04bb-4d9c-a96f-553db2b49e8f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.629081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.629749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.630037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.630321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.631200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] RBAC: Adding query filter params (role.id=dc96b5972b6749198fa21417d94cfdbb, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=232b92d1afef4044bf608e629de2e966) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:00.631520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.632970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1021e4-fc87-4031-a95b-f6d690e1ef70 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.646518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 450/912] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/role_assignments?user.id=232b92d1afef4044bf608e629de2e966&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=dc96b5972b6749198fa21417d94cfdbb => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:00.731795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada05b-17e4-4ca8-9d27-95cd6f2cc780 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.732314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada05b-17e4-4ca8-9d27-95cd6f2cc780 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.732392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada05b-17e4-4ca8-9d27-95cd6f2cc780 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.733867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 463/913] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:00.739874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.740474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.740961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.759910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:00.761474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.765068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.837956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 451/914] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:00.862558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ada05b-17e4-4ca8-9d27-95cd6f2cc780 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.917389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.969788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ada05b-17e4-4ca8-9d27-95cd6f2cc780 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.006096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.006997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.007281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.007557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.008277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.009655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:01.022861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:01.023885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:01.024711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 464/915] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:01.035448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.144235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a01642-f19f-4f2d-8640-55a0b1f4c56f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.183284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.183974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.184266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.184552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.185287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:01.185603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.187014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721109f4-4cff-4b57-ad27-bfe78046d85b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.195816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 452/916] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:01.201460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.219846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0efb9-7b6e-4fcb-89b7-52804a6fa23c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.220873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0efb9-7b6e-4fcb-89b7-52804a6fa23c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.221366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0efb9-7b6e-4fcb-89b7-52804a6fa23c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.223408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 453/917] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:01.230943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.231482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.232123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.240894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.255948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:01.258083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.317661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5876-78d0-4279-9c77-4d61fb347e30 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.333889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.346498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 454/918] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:01.362497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.363433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.363936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.364410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.365366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:01.365924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.367509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.371939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.373901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 465/919] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:01.382449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.490530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80d388-e239-4184-b722-b468a0b626f9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.512669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711378e-9d42-4cd3-84b9-772377ec778e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.544204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.545016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.545300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.545576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.546291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.549160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.552212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.559427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.560376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.560866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.561359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.562348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.564000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:01.567396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:01.568377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:01.569216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:01.573576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 455/920] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:01.574415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.598627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 466/921] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:33:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:01.716425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0a42-a8aa-45f0-8750-636a118a77e6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.760485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.761077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.761360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.761637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.762382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:01.762700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.764078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.769982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 456/922] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:01.776054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.813405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.893706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fde31-fb24-4ec3-8482-57df9bdd423d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.930096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.930792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.931077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.931356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.932063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:01.932371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.933737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.939134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 467/923] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:01.945209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.010748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.051113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62c633-853d-4153-b1f5-17c2281fcdab None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.086589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.087295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.087578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.087899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.088694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] RBAC: Adding query filter params (interface=public, service_id=2d0928fea7c044cfaa8d3bf368dc6316, region_id=RegionOne) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:02.089004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.090384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58547-2eb5-4575-8cc7-54defe4d0697 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.096081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 457/924] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/endpoints?service_id=2d0928fea7c044cfaa8d3bf368dc6316&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:02.101617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.203094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.205807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e31d-6bb1-4795-83d8-036dd4b702c0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.240764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f663-2f09-413e-924a-17153b7eddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.241430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f663-2f09-413e-924a-17153b7eddd9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.241711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f663-2f09-413e-924a-17153b7eddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.241989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f663-2f09-413e-924a-17153b7eddd9 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.242701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1f663-2f09-413e-924a-17153b7eddd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.244132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1f663-2f09-413e-924a-17153b7eddd9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.250495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 468/925] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:02.413386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a41f74-b09a-4d8b-af40-f4fe42fa68bd None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.413753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a41f74-b09a-4d8b-af40-f4fe42fa68bd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.413954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a41f74-b09a-4d8b-af40-f4fe42fa68bd None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.415594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 458/926] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:02.421182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.421720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.422215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.440506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:02.442010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.512079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 469/927] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:02.535823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a41f74-b09a-4d8b-af40-f4fe42fa68bd None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.641779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a41f74-b09a-4d8b-af40-f4fe42fa68bd None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.665389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.677326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.678145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.678469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.678852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.679520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.681462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-fe2e4afd-3567-473c-bfc4-8232f20d47c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:02.694947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:02.695941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:02.697038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 459/928] 10.222.0.64 () {56 vars in 1132 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:02.703811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.799501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.800270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bf85-f390-46e5-8c44-bab73ac9e154 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.801026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bf85-f390-46e5-8c44-bab73ac9e154 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.801384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bf85-f390-46e5-8c44-bab73ac9e154 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.803057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 460/929] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:02.808590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.808954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.809312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.811004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232dd3-94e8-40bd-9041-d2f7b88153b0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.826585 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:02.827928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.851275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.852659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.853127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.853807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.854723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:02.855319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.857482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.864340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 470/930] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:02.870909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.914537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 461/931] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:02.930023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.995858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662ef3-0d65-491d-84f7-0a0bd6c05272 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.046054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.047185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.047650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.048105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.048523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c346-2a89-42e4-8536-42add9b26978 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.049766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:03.050369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.052893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.063850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 471/932] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:03.064884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.086779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.094321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.100613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.101429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.101712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.101991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.114931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:03.122545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:03.123489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:03.130434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 462/933] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:03.133851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.204284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5f90-a056-4c40-b947-e372b95e8075 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.246979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.248093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.248601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.249193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.250600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.252700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.269717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db049fd-b659-459e-8699-e7725a9492ea None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.280281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 472/934] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:33:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:03.325195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.326239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.326698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.327133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.328082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:03.328614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.331044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.346598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 463/935] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:03.348331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.437838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.464151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1db3-03b9-486c-b240-fa09cd726957 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.501752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.503121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.503407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.503685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.517147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.518680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:03.536757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:03.537752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:03.538706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:03.538706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:03.538706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:03.538706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:03.538706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 473/936] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:03.543943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.582179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.653029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58e9a9-af79-410f-9e21-fa06d2fc027f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.693561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.694239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.694561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.694848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.695638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:03.695953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.697378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d917613-2745-4203-9bcc-4f331b55a57f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.710083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 464/937] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:03.715684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.829437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a1cd0-46e5-4331-bf8b-a5be3bf1f9fd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.858335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.867962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.869153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.869651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.870124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.877634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05523d1-995f-43d2-9c6e-34341bc8e591 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.878116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05523d1-995f-43d2-9c6e-34341bc8e591 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.878399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05523d1-995f-43d2-9c6e-34341bc8e591 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.879272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.880064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 465/938] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:03.880715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.886391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.886391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.886391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:33:03.897018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:03.898009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:03.898992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 474/939] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:03.904410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.909798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:03.911190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.997953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 466/940] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:04.015191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27ad6-235d-48a4-be76-97ef55fea333 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.022109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.048894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.054813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.055756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.056048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.056435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.057291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:04.057612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.059106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.078446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 475/941] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:04.085423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.143693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7f6b1-afc7-4e76-b154-e8411a1c2076 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.145312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.181448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.182524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.183014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.183496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.184452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.186295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.187895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING keystone.server.flask.common [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 15:33:04.207193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.sql.core [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 15:33:04.207193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 15:33:04.207193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [parameters: {'id': 'e48ce131db604e98a0ce4a9a664ebab3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 15:33:04.207193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86832) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 15:33:04.210725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37a0c1-97cb-4893-9a58-633860d402ac None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e48ce131db604e98a0ce4a9a664ebab3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e48ce131db604e98a0ce4a9a664ebab3. Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:33:04.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result.read() Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 15:33:04.217931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application yield resource Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise self.value Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application session.commit() Jul 19 15:33:04.219108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.session.flush() Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application compat.raise_( Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 15:33:04.220213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 15:33:04.221591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result.read() Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:33:04.222587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [parameters: {'id': 'e48ce131db604e98a0ce4a9a664ebab3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.224205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:04.226282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e48ce131db604e98a0ce4a9a664ebab3. Jul 19 15:33:04.229140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.231784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 467/942] 10.222.0.64 () {60 vars in 1140 bytes} [Tue Jul 19 15:33:04 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:04.237887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.264558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.265283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.265832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.266120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.280114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.282571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:04.304405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:04.305355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:04.306281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:04.306281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:04.306281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:04.306281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:04.306281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 476/943] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:04.312908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.346817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.374952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac959c-511c-439a-9284-3e1113947760 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.422424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.423270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.423559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.424408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.433635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.435934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.436996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.443530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b28dc-7929-4b52-9fd7-e69d542d63c9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:04.452989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:04.453883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:04.454838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.458523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 468/944] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:04.460758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.492874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.493641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.494092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.494391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.495157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:04.495469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.496837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aeff3-b50d-4b91-b83f-dba413cd4c49 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.509304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 477/945] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:04.510499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7d8b-9334-4a84-9f9c-f1a3428289e9 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.510802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7d8b-9334-4a84-9f9c-f1a3428289e9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.511066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7d8b-9334-4a84-9f9c-f1a3428289e9 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.512295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 478/946] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:04.515058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b7d8b-9334-4a84-9f9c-f1a3428289e9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.583478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1386fde-c5cc-4140-9035-761e19c94e23 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.622203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b7d8b-9334-4a84-9f9c-f1a3428289e9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.626007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.626711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.627556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.628068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.628844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:04.629161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.631070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5c95-3dcc-43f4-a61f-511e432bd2e2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.646843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.663201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 469/947] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:04.664954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.665251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.665794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.671518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.671518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.671518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.671518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.685662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:04.687385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:04.688462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.691153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:04.712232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:04.713202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:04.714077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 479/948] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:04.719559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.744660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.774890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 470/949] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:04.793911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.856066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27ff80-081d-4702-9543-f9e8a537c0e6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.901918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.902661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.902952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.903237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.904231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:04.904550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.907776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.921665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c99662-e425-45e0-a661-bb339a7f3d80 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.923904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 480/950] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:04.930141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.954399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.962156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.963099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.964100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.964452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.965235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.966668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:04.981502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:04.982570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:04.983435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:04.984189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 471/951] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:04.989778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.028564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.052573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796e42-103b-421f-8b7a-533fa929d89d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.088669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.089942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.090480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.091089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/232b92d1afef4044bf608e629de2e966/roles/dc96b5972b6749198fa21417d94cfdbb` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.093664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=232b92d1afef4044bf608e629de2e966, role_id=dc96b5972b6749198fa21417d94cfdbb)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.095345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.099424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036e236-13d4-4bc6-9551-33764f7e4340 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.110850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 481/952] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:33:04 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/232b92d1afef4044bf608e629de2e966/roles/dc96b5972b6749198fa21417d94cfdbb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:05.139988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.140738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.141029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.141311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.142105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:05.142711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.144307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.150963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 472/953] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:05.157024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.281570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a0aa-d15e-4a94-9ae0-6c364bbc6f63 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.319119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.320226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.320711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.321229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.322209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:05.322735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.324371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379932a-6b41-40ec-9e81-03886185e0f9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.334479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 482/954] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:05.336751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.400954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.446748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351711e-9b93-435d-b4eb-d81fa611fae5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.482704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41a7d2-c99d-4e7c-a2f4-254963b66e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.483378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41a7d2-c99d-4e7c-a2f4-254963b66e40 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.483660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41a7d2-c99d-4e7c-a2f4-254963b66e40 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.483943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41a7d2-c99d-4e7c-a2f4-254963b66e40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.484716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41a7d2-c99d-4e7c-a2f4-254963b66e40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.486653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41a7d2-c99d-4e7c-a2f4-254963b66e40 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.509281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 473/955] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:33:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:05.515944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f215630-3e61-44fd-bb6f-30dba8eab762 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.516267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f215630-3e61-44fd-bb6f-30dba8eab762 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.516514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f215630-3e61-44fd-bb6f-30dba8eab762 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.518761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 483/956] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:05.524657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.524983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.525223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.544357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:05.545496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.635833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 474/957] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:05.659220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f215630-3e61-44fd-bb6f-30dba8eab762 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.663110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.788059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f215630-3e61-44fd-bb6f-30dba8eab762 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.826050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.826850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.827174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.827456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.828166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.829594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:05.841995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:05.843156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:05.844418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 484/958] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:05.850009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.894057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.958145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63432-5cf2-43e2-b772-969e3c8ca5eb None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.994882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.995571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.995859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.996143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.996871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:05.997182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.998604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef8246-41c1-4093-8237-a40339342e2a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.004698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 475/959] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:06.010004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:06.082888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:06.120167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536defd6-4bba-4d44-a1d7-a94fabfa80d9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.154836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.155493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.155776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.156052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.156761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:06.157067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.159232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b48e2a-7404-4995-b0d6-81f3b140233f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.164218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 485/960] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:06.948092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067b6b-406b-4dd9-bf54-e499ecfc595f None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.948406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067b6b-406b-4dd9-bf54-e499ecfc595f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.948566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067b6b-406b-4dd9-bf54-e499ecfc595f None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.950187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 476/961] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:06.956116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.956414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.956696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.973420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:06.974645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.043734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 486/962] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:07.069072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067b6b-406b-4dd9-bf54-e499ecfc595f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.180374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067b6b-406b-4dd9-bf54-e499ecfc595f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.182760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.216199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.216794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.217081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.217361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.218084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.219640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.235226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.sql.core [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 15:33:07.235226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 15:33:07.235226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [parameters: {'user_id': 'e478816587c0448ba303096ba72952c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 15:33:07.235226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86832) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d3145d65-4834-42f0-9771-bb1788da4b2a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result.read() Jul 19 15:33:07.243698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:33:07.244573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application yield resource Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise self.value Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application session.commit() Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 15:33:07.246113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.session.flush() Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application compat.raise_( Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 15:33:07.247252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:33:07.248328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application result.read() Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:33:07.249355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e478816587c0448ba303096ba72952c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:07.254453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 15:33:07.257277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:07.259398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 477/963] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 19 15:33:07 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:07.260285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.307791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5bd4a-f31f-4f45-a34f-82fa1890f32c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.308100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5bd4a-f31f-4f45-a34f-82fa1890f32c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.308353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5bd4a-f31f-4f45-a34f-82fa1890f32c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.312904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 478/964] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:07.318582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.318871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.319153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.324763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.337866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:07.339439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.375149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f7965-606d-48df-9979-8c1c0a827fd2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.421613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.422458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.422749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.423030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.425283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 479/965] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:07.434971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.436420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.443410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:33:07.452528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:07.453481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:07.454684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 487/966] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:07.459349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.555094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e975ce-1cdc-4b48-aecf-f4c42554597e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.558711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.563037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0e079-4e8a-4533-8e1a-653b3bc31278 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.585059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.596076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.597205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.597727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.598273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.603530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.604196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.604565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.604925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.605742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:07.606051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.607798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678013a4-216e-4c6a-8959-6a71cde9d6e8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.610388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:07.619568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:07.620702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:07.621731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:07.629227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 480/967] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:07.630721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.646396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 488/968] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:07.766634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88b4e-34ef-45b6-8bcb-de98845c7e57 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.781199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00029dc-5dff-4fee-95ae-2aee070c2c73 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.781551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00029dc-5dff-4fee-95ae-2aee070c2c73 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.781761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00029dc-5dff-4fee-95ae-2aee070c2c73 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.783706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 489/969] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:07.792560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.792560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.792560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.810765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:07.812282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.813099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.813787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.814070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.814519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.815294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:07.815603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.818412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.829448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 481/970] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:07.836053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.858535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.904941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 490/971] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:07.929512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.966638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad5fda-95f1-4fb7-b8f6-e999b84bd54e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.006174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.007025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.007324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.007589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.019928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.021372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:08.042065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:08.043046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:08.043909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:08.043909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:08.043909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:08.043909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:08.044214 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 482/972] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:08.049609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.051189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f415-392c-4824-83f1-59c6bd1b2ca5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.061731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.089913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.090749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.091059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.091674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.091989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.093387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:08.110847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:08.111894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:08.112732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:08.117166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 491/973] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:08.118452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.128103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.163563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3931c-ce25-4c6e-8249-dd84179091a4 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.198923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.199584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.199873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.200208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.200934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:08.201269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.202651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.215138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 483/974] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:08.221951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.234767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec34b8-7a8e-4593-807b-76839533a84f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.275377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.276303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.276584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.276860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.277570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:08.278119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.279267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.289554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 492/975] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:08.290268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.328487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e845-86f5-4f59-8548-471cf3f261ed None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.334558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.360386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.367736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.368525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.368803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.369073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.376254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.378008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a4418a4f-aaf1-4d22-a551-9bd44d80cff2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:33:08.392886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:08.394023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:08.395246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 484/976] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:08.395988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cb874-b620-480a-a9cb-17411063c4e4 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.395988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cb874-b620-480a-a9cb-17411063c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.395988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cb874-b620-480a-a9cb-17411063c4e4 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.397160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 485/977] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:08.399930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cb874-b620-480a-a9cb-17411063c4e4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.405015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea37d1f-c9e5-40cf-8555-52bfb4db5042 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.439767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.440419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.440706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.440985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.441686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:08.442000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.443398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fe7e-4b82-4819-a223-879a8a19da82 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.448758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 493/978] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:08.449905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.450195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.450508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.469327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:08.471172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.505541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cb874-b620-480a-a9cb-17411063c4e4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.537383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 494/979] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:08.538720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.552477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.553154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.553445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.553724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.554601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:08.554916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.556353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.569014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.574897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 486/980] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:08.575694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.623887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.639083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5897-bb8a-4c45-9c4b-0354a78ef3d2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.674727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.675389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.675670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.675947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.676745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0118949-637f-49d8-9483-e0b8f1eb9aea None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.676860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] RBAC: Adding query filter params (interface=admin, service_id=2d0928fea7c044cfaa8d3bf368dc6316, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:08.677054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.678446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.683722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 495/981] 10.222.0.64 () {56 vars in 1249 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/endpoints?service_id=2d0928fea7c044cfaa8d3bf368dc6316&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:08.684519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.715284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.715951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.716239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.716515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.717258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.718647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.731209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 487/982] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:08.732070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.785437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.793902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca859963-aa0e-4d55-89f6-0468d47516f8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.841766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.842475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.842763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.843036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.877663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8a76-a13f-41cd-a866-3c5538332d16 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.889724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.926425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.927904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.931727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.932400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.932682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.932957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.933643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.935041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.942332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 488/983] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/services => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:09.024683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.037658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 496/984] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:09.043775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.155177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f02f-0881-453c-a2e4-c43ff953b4e8 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.193389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.194826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.195146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.195429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.207056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.208526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:09.228876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:09.229840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:09.231226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:09.231226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:09.231226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:09.231226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:09.231226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 489/985] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:09.234336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.341501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582afb-68c3-4750-ac5b-4f742bb962c2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.376856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.377521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.377810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.378088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.378842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:09.379155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.380520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.397627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 497/986] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:09.398862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.425620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.505684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96173a-35af-4eaf-a53b-70770e5f21bc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.541015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.541813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.542105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.542421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.549752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.551612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:09.566939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:09.567853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:09.568721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:09.569646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 490/987] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:09.574875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.629916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.687720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db743ca1-be8d-4eda-94ab-5a8aa450c6e3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.726147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.726845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.727135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.727417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.728215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:09.728530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.729960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b76731-9b7f-416f-910b-0c4586e03434 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.743395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 498/988] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:09.749146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.838021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.857005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216f28-d650-422c-b28b-59ba7b931dc0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.892892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.893573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.893864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.894149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.895046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] RBAC: Adding query filter params (role.id=dc96b5972b6749198fa21417d94cfdbb, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=232b92d1afef4044bf608e629de2e966) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:09.895369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.896825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e7adf-8c5c-40b2-baae-e984ac88c861 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.903999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 491/989] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/role_assignments?user.id=232b92d1afef4044bf608e629de2e966&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=dc96b5972b6749198fa21417d94cfdbb => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:10.837510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003a39-39c0-475f-a559-3c8b1b6b6afb None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.838046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003a39-39c0-475f-a559-3c8b1b6b6afb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.838134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003a39-39c0-475f-a559-3c8b1b6b6afb None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.839624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 499/990] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:10.844634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781afba-2e5d-4090-8fc4-4768c7a937e7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.845051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781afba-2e5d-4090-8fc4-4768c7a937e7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.845271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781afba-2e5d-4090-8fc4-4768c7a937e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.862966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7781afba-2e5d-4090-8fc4-4768c7a937e7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:10.864329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7781afba-2e5d-4090-8fc4-4768c7a937e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.934331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 492/991] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:10.957496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003a39-39c0-475f-a559-3c8b1b6b6afb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.035016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cb385-f27e-4ce2-9ebb-e1376bafd346 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.035347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cb385-f27e-4ce2-9ebb-e1376bafd346 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.035573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cb385-f27e-4ce2-9ebb-e1376bafd346 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.037280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 493/992] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:11.043038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.043320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.043606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.060549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:11.061724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.071173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003a39-39c0-475f-a559-3c8b1b6b6afb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.082780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.107979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.108771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.109054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.109328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.109978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.111453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:11.123290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:11.124298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:11.125150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 500/993] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:11.130960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.142974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 494/994] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:11.165801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.177313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.238903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70464273-6dfe-462a-b1e3-7d572eeeea03 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.275961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.276934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.277430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67f9ef-ddd3-4fac-b25a-3012a098d8b0 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.277646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.278131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.279178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] RBAC: Adding query filter params (name=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:11.279831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.281273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.286676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 501/995] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:11.292022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.313371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.315402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.315672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.315951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.316770 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.318136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:11.331054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:11.332050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:11.335496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 495/996] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:11.336343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.338291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.404912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ffb9-79e8-42e3-ad07-fc41bc6025cd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.413884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.440170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.440842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.441135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.441413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.442121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:11.442464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.443834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.448363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e088a0-e7f9-4112-8ab3-5da0109671d3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.448818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 502/997] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:11.454523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.486793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.487458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.487745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.488022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.488747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:11.489112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.490454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.495444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 496/998] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:11.500953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.568312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af25f-46e5-480c-80b6-2ca0b41e30e4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.570749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.606188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.606889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.607144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed0d8-a3db-45cb-a059-0e10c465d26c None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.607248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.607449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.608251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] RBAC: Adding query filter params (interface=public, service_id=9849310ba1ab4f699b0d319f89ed6d18, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:11.608569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.610204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.616160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 503/999] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/endpoints?service_id=9849310ba1ab4f699b0d319f89ed6d18&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:11.621367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.646081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.646777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.647059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.647344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.648199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:11.648507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.649863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.652661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.661507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 497/1000] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:11.662878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.745028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ba996-cfa1-4b7c-9fcf-20e40bdf4987 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.766552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfcdfa-96dd-475c-8281-256c94bffb7a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.782769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be566de-d41d-44bc-8b72-5ae719dfd6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.783831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be566de-d41d-44bc-8b72-5ae719dfd6ff None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.784410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be566de-d41d-44bc-8b72-5ae719dfd6ff None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.784876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be566de-d41d-44bc-8b72-5ae719dfd6ff None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.785646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be566de-d41d-44bc-8b72-5ae719dfd6ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.787048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be566de-d41d-44bc-8b72-5ae719dfd6ff None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.793443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 504/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:11.803094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929adc4-4153-4ae9-beb9-d6bca9e2ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.804138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929adc4-4153-4ae9-beb9-d6bca9e2ddae None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.804697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929adc4-4153-4ae9-beb9-d6bca9e2ddae None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.805191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929adc4-4153-4ae9-beb9-d6bca9e2ddae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.806188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929adc4-4153-4ae9-beb9-d6bca9e2ddae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.807862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929adc4-4153-4ae9-beb9-d6bca9e2ddae None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.827128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 498/1002] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:12.000455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b4261-fb6e-4077-a15f-c65171b14a55 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.000967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b4261-fb6e-4077-a15f-c65171b14a55 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.000967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b4261-fb6e-4077-a15f-c65171b14a55 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.003014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 505/1003] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:12.008403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.008809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.009004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.026793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:12.027979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.084532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:12.104547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 499/1004] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:12.127186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b4261-fb6e-4077-a15f-c65171b14a55 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.158919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:12.232680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b4261-fb6e-4077-a15f-c65171b14a55 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.274387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.275107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.275391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.275927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] PATH_INFO: `/v3/services/image` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.276578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.277939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:12.290090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:12.291157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:12.292006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:12.294434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 506/1005] 10.222.0.64 () {56 vars in 1105 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:12.297546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.399531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec8ea9-2edd-497f-be79-e7b7c50ab31d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.433472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.434139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.434446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.434724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.435430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] RBAC: Adding query filter params (name=image) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:12.435735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.437099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b55b1-c280-440b-b039-d254e3fb496f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.446388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 500/1006] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:12.448157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.547639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:12.555829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31acb-7cb9-4f28-83e9-c1018c5540ce None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.590218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.590925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.591213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.591496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.592218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] RBAC: Adding query filter params (type=image) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:12.592516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.593880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e4ddf-fbb2-42f1-985a-45da314a0fc2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.606385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 507/1007] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:13.870079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccac6d-1538-4743-8716-90d506a8719e None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.870620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccac6d-1538-4743-8716-90d506a8719e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.870698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccac6d-1538-4743-8716-90d506a8719e None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.872171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 501/1008] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:13.877396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.877844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.877992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.895374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:13.896545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:13.938393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b5e43-7419-4b19-a480-697492ccb095 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.938581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b5e43-7419-4b19-a480-697492ccb095 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.938864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b5e43-7419-4b19-a480-697492ccb095 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.940736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 502/1009] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:13.945411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.945704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.946000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.964326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:13.965506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 508/1010] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:13.965620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:13.989215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.014906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.041467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 503/1011] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:14.066278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.091919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.106286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac99a9-3045-4256-b4df-6489c89f73f5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.143873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.144692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.144978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.145248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.145912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.147318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:14.160135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:14.161131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:14.162132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 509/1012] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:14.167195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.183807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e531-943d-4450-8445-75bdc428bb6a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.223050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.223817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.224109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.224391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.225581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.227078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.233531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 504/1013] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:14.234909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.278567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6323-6c57-4b56-aef1-4e3f3210a709 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.285379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.317306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.318035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.318324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.318624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.319335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] RBAC: Adding query filter params (name=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:14.319644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.321216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.326162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 510/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:14.331864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.341519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7ecb-bcba-450f-af8f-01c134f4e3e6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.350933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.379784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.380445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.380730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.381011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.381747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.383267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.422391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 505/1015] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:33:14 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:14.440213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715db06d-68fc-4211-b803-4e0b070db23c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.479231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.479948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.480240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.480519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.481290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:14.481606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.483093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ea45-d731-4bfb-893c-4d92ca87262b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.494191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 511/1016] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 19 15:33:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:14.495737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.604906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.608950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980ce7-4d70-4b36-98c0-c057281d9d53 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.645559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a204b-b4df-44e5-b6db-4691c617ee47 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.645941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a204b-b4df-44e5-b6db-4691c617ee47 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.646223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a204b-b4df-44e5-b6db-4691c617ee47 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.647628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 512/1017] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:14.649344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.649879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.650169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.650498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.651688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.652912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.653295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fadb4-099a-4705-a2a9-cd15822575ac None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.653584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fadb4-099a-4705-a2a9-cd15822575ac None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.653863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fadb4-099a-4705-a2a9-cd15822575ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.673520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ee1fadb4-099a-4705-a2a9-cd15822575ac None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:14.674602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 506/1018] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:33:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:14.676426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee1fadb4-099a-4705-a2a9-cd15822575ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:14.764530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 513/1019] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:14.788134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.927429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561c56-2f71-4bba-ac8e-be6b7d493f3d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.974486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b906214-6cfb-4525-a769-15a55760aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.975161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906214-6cfb-4525-a769-15a55760aeb3 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.975446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906214-6cfb-4525-a769-15a55760aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.975725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906214-6cfb-4525-a769-15a55760aeb3 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.976463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b906214-6cfb-4525-a769-15a55760aeb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.977924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b906214-6cfb-4525-a769-15a55760aeb3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.994438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 507/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:33:14 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:16.602799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2d98-f819-49f3-b64f-b3e0a738114f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.603326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2d98-f819-49f3-b64f-b3e0a738114f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.603415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2d98-f819-49f3-b64f-b3e0a738114f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.604980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 514/1021] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:16.610166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f652-b280-487b-b5d9-81ffaec575f6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.610569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f652-b280-487b-b5d9-81ffaec575f6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.610767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f652-b280-487b-b5d9-81ffaec575f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.628893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7386f652-b280-487b-b5d9-81ffaec575f6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:16.630070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7386f652-b280-487b-b5d9-81ffaec575f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:16.643329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:16.718131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 508/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:16.742521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2d98-f819-49f3-b64f-b3e0a738114f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.751760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:16.848988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2d98-f819-49f3-b64f-b3e0a738114f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.851071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e05c5-df8f-4d6f-b782-3db61142fe37 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.851430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e05c5-df8f-4d6f-b782-3db61142fe37 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.851778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e05c5-df8f-4d6f-b782-3db61142fe37 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.853297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 509/1023] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:16.858259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.858601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.858885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.875594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:16.877116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:16.890767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.891680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.892854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.893537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.895087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.896814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.902680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 515/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:16.904631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.950690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 510/1025] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:16.975616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.990047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.018215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ce288-2dc8-46ea-8a04-993c3ea1c265 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.052523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.055940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43036a7-ad9d-444b-89d4-220b17adca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.056622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43036a7-ad9d-444b-89d4-220b17adca87 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.056908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43036a7-ad9d-444b-89d4-220b17adca87 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.057188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43036a7-ad9d-444b-89d4-220b17adca87 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.057902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43036a7-ad9d-444b-89d4-220b17adca87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.059364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43036a7-ad9d-444b-89d4-220b17adca87 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.082293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 516/1026] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:17.083919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a78b-d136-44a1-bc7a-4e52a08aa2d6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.084211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a78b-d136-44a1-bc7a-4e52a08aa2d6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.084500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a78b-d136-44a1-bc7a-4e52a08aa2d6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.085799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 517/1027] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:17.087016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cd15-f646-4677-9528-f2ef610aacf9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.091976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.092308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.092538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.111316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:17.112472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:17.129921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.130800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.131090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.131371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.144813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:17.154229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:17.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:17.156379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:17.158803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 511/1028] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:17.162693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.194397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 518/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:17.214551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.282075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872623a-65c9-4f2f-a728-43dd96c99b6e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.289528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.320999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.327111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.327791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.328075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.328351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.329102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:17.329410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.331696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.340426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 512/1030] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:17.347434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.349770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfb5b9-b9b0-43c0-8fba-fd35d75ea813 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.387959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.388680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.388966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.389243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.389901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.391313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:17.403489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:17.404527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:17.405445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 519/1031] 10.222.0.64 () {56 vars in 1105 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:17.411592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.463037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e22c27-742d-4ec6-b47e-6a1f4a27041b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.501589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.503004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.503294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.503569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.516119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.518269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.525388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684c0f-e237-4698-947b-12cc64f181c0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:17.536820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:17.537732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:17.538668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:17.538668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:17.538668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:17.538668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:17.538668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 513/1032] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:17.543744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.552362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.565000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.565673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.565962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.566244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.566998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] RBAC: Adding query filter params (name=image) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:17.567311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.568700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.578266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 520/1033] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:17.579285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.600958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.662167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172811e-48d1-4e69-b0fa-944b0a9f2cf3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.696098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6df8-bdf2-43cd-98d8-fda468ded293 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.707337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.708304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.708596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.708875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.709772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:17.710484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.711868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.724556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 514/1034] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:17.729971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.731933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.732602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.732891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.733172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.734076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:17.734189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.735700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.742399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 521/1035] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:17.747898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.805251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.841670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf63696-cd64-4c13-8f9e-3050ba921ac3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.849975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.858570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f6531-42fc-410b-8dcf-8902f1c6ecb3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.880033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.880820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.881102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.881378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.888730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.890164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.897953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.898641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.898936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.899247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.900036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] RBAC: Adding query filter params (interface=public, service_id=067d80a979804c79b7dbfe40f0e027bc, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:17.900355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.901983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:33:17.905412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:17.906606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:17.907609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 515/1036] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:17.915697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 522/1037] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/endpoints?service_id=067d80a979804c79b7dbfe40f0e027bc&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:17.915890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.916764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.021000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095aa8c5-0b42-4a5d-b5a3-b4b541332f5d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.023491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518b05-da2f-49d7-9c59-2bbd699d401c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.039742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:18.058602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.059264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.059551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.059831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.060516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.061544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.061878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.062763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.063214 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.063645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.065136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:18.065634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.067148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.069692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 523/1038] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:18.091711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 516/1039] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:18.093074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.205893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897adb-0758-4c0b-a0ec-ff3f837909db None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.244987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.245651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.245941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.246223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.302406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:18.320458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.321957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.421937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 524/1040] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:18.428046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.455173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:18.534487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19960-d604-4d77-a183-6cfd9d1d3f53 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.573172 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.573983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.574273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.574587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.587283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.588749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:18.607340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:18.608266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:18.609160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:18.609160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:18.609160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:18.609160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:18.610737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 517/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:18.615250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.704190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:18.725800 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a06d-8532-4a55-9b4a-b6c61205c86e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.761448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.762111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.762421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.762705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.763427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:18.763738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.765106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.781577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 525/1042] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:18.783935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.869191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:18.893230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39ab0e-cb27-4d6a-aa3f-4be8bba6fd22 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.929449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.930242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.930554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.930837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.937444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.938956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:18.952396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:18.953265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:18.959768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 518/1043] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:18.961679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.063132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6733d-1c27-400f-8681-88d94972c03c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.097948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.098647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.098940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.099227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.100016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:19.100333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.101772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca2aae-8ffb-412e-9a93-8982bd5b4a34 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.111858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:19.121098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 526/1044] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:19.122841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.215488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ca13-0d1f-483f-b49d-e94f689a1316 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.215779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ca13-0d1f-483f-b49d-e94f689a1316 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.216072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ca13-0d1f-483f-b49d-e94f689a1316 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.217443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 527/1045] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:19.222560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.222855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.223138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.229584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacbca2-3e71-4f57-bb20-badb77c04015 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.240485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:19.241689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:19.266088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.266785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.267068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.267961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.268896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] RBAC: Adding query filter params (role.id=dc96b5972b6749198fa21417d94cfdbb, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=a3981687a6c741afbd3d22eb49fe4da7) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:19.269211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.270657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.273871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:19.286756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 519/1046] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/role_assignments?user.id=a3981687a6c741afbd3d22eb49fe4da7&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=dc96b5972b6749198fa21417d94cfdbb => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:19.330465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 528/1047] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:19.349891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.463483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4939a80-ede8-4f94-9d54-33100d552d48 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.497539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.498323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.498703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.498982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.509752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:19.517910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:19.518903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:19.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:19.522431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 520/1048] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:19.525276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.627142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39b1f-2855-4ee6-a65a-f3de66a2b9d3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.656582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:19.664607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.665281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.665564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.665840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.666617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:19.666926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.668290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.684615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 529/1049] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:19.690918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.759366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:19.804215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efb412-6447-483f-9276-4f8c29e835cf None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.839516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b699b1-e3fc-47eb-ac35-373aadbfca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.840395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b699b1-e3fc-47eb-ac35-373aadbfca60 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.840683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b699b1-e3fc-47eb-ac35-373aadbfca60 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.840966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b699b1-e3fc-47eb-ac35-373aadbfca60 None admin] PATH_INFO: `/v3/users/291eaeeb966e4888baa8334c0c7921ff` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.855169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b699b1-e3fc-47eb-ac35-373aadbfca60 None admin] RBAC: Authorizing `identity:get_user(user_id=291eaeeb966e4888baa8334c0c7921ff)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.856637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b699b1-e3fc-47eb-ac35-373aadbfca60 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.862933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 521/1050] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/users/291eaeeb966e4888baa8334c0c7921ff => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:19.864272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.965874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8015981-da8d-49ae-88f0-5e1c4a4ac5a1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.000225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.000880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.001169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.001505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.061610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:20.073229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.074730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.155705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9212e6-de10-459e-892c-da16d2275b36 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.156024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9212e6-de10-459e-892c-da16d2275b36 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.156275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9212e6-de10-459e-892c-da16d2275b36 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.158184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 522/1051] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:20.163396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.163697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.163978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.179872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 530/1052] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:20.180951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.186024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:20.187338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:20.268424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 523/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:20.278572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:20.281504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.289526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94ec57-d4b4-4de5-8896-0e9ba6820852 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.328238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.329021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.329303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.329682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.331289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b2cd2291104145b22e2fc90080f426)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.332729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.333439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:20.334497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 531/1054] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:20 2022] GET /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:20.340874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.389324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335098-a607-4f5b-908d-dd6a7ae3245b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.425564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.426433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.426678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.426969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] PATH_INFO: `/v3/services/image` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.427633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.429016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:20.441271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:20.442275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:33:20.443193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:20.447520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 524/1055] 10.222.0.64 () {56 vars in 1105 bytes} [Tue Jul 19 15:33:20 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:20.448251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.453165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f451-959d-401f-b93b-a5792382f858 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.490562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.491670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.492187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.492721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.493833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=b9b2cd2291104145b22e2fc90080f426, user.id=291eaeeb966e4888baa8334c0c7921ff) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:20.494393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.496296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.510095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 532/1056] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:20 2022] GET /identity/v3/role_assignments?user.id=291eaeeb966e4888baa8334c0c7921ff&scope.project.id=b9b2cd2291104145b22e2fc90080f426&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:20.552041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0fad8-914f-45c3-a706-0c6c5af7abfb None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.566375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:20.591021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.591711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.592002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.592287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.593017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] RBAC: Adding query filter params (name=image) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:20.593340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.594799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.605975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 525/1057] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:20.607032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.635088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:20.723698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f34e-bdde-479b-a203-0afb88f0d046 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.758125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.758862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.759155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.759438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.760157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] RBAC: Adding query filter params (type=image) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:20.760473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.761851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea3418-591b-4412-8b4a-57c7f1776dc9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.766970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 533/1058] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:20.772860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.873357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df050d-b22c-45a1-90a6-49d000c44038 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.907774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ae15-56da-4bf0-ae81-6336c6649ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.908677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ae15-56da-4bf0-ae81-6336c6649ce1 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.908966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ae15-56da-4bf0-ae81-6336c6649ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.909246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ae15-56da-4bf0-ae81-6336c6649ce1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.909997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ae15-56da-4bf0-ae81-6336c6649ce1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.911403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ae15-56da-4bf0-ae81-6336c6649ce1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.931507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 526/1059] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:33:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:21.330653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96068c50-bef2-4ca5-bc81-c14352c95108 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.331147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96068c50-bef2-4ca5-bc81-c14352c95108 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.331384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96068c50-bef2-4ca5-bc81-c14352c95108 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.332932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 534/1060] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:21.337888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.338179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.338493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.355204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:21.356376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.383150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:21.441300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 527/1061] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:21.463442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96068c50-bef2-4ca5-bc81-c14352c95108 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.554203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:21.569373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96068c50-bef2-4ca5-bc81-c14352c95108 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.610257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.610257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.610568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.610644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.621931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:21.631218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:21.632239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:21.634170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 535/1062] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:21.638711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.757195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65fcf-c8b3-4143-832d-f984f4ede34e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.791136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.791807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.792096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.792418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.793118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:21.793432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.794845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.803051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 528/1063] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:21.814449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.910157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7abb57-c316-44e8-bba2-e669f5e8d43a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.943459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.944250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.944536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.944892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.955431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.956869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.964668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:21.974796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:21.975713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:21.976677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:21.976677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:21.976677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:21.976677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:21.976677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 536/1064] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:21.982146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.005486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.089251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938ca5a-afbb-4d1e-bd6e-aa0d9aab4700 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.125638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.127122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.127621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.128068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.128925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:22.129378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.130921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.143787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 529/1065] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:22.149291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.251883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b02-0d61-4f9f-9d67-66e8398a16bb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.286225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.287056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.287339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.287614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.295738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.297170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:33:22.311288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:22.312258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:22.313295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 537/1066] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:22.320179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.413574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.435078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e05df-de12-4afe-b801-9ed5c8274854 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.472285 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.473336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.473727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.474109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.475192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:22.475617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.477177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66954b1d-eeed-4873-ae26-8db2050e7439 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.502226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 530/1067] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:22.502418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.566929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.608649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41316c8-393e-4473-94a7-e0b362cfcb2e None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.608973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41316c8-393e-4473-94a7-e0b362cfcb2e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.609229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41316c8-393e-4473-94a7-e0b362cfcb2e None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.614923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 531/1068] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:22.615091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf291-0acf-4837-9a40-965a461385a6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.616209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.616505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.616793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.636263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:22.637465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:22.659216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.660774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.661878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.662176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.685265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.686317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:22.706694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:22.707638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:22.708524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:22.708524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:22.708524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:22.708524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:22.711208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 538/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:22.716707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.721610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 532/1070] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:22.745088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.831257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.842370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f2e5-d76a-4883-af3d-bf0e4ac032f7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.858275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.867221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e576-e906-4f41-8cd2-4d1d95b5a71e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.882674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.883992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.884486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.884776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.885520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:22.885837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.887249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.904663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 539/1071] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:22.905815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.908721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.910191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.910191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.910191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.920672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:22.929075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:22.930100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:22.931948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 533/1072] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:22.936258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.012199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ccc06-4653-475c-8600-874a85b1e041 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.042921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c984-3497-4864-872f-27d0225ff73f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.046228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.047051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.047336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.047609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.054920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.056360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.069521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-242c0cbe-b014-46d3-b5a1-0081e0c2e8bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:23.070735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:23.071986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:23.072889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 540/1073] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:23.073760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dae2-b1f9-4cce-8959-c761bf129abf None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.073832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dae2-b1f9-4cce-8959-c761bf129abf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.074094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dae2-b1f9-4cce-8959-c761bf129abf None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.075508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 541/1074] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:23.077760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dae2-b1f9-4cce-8959-c761bf129abf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.080808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.081718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.082527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.082842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.083657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:23.083977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.085360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dfdf9-733f-4b61-a2f9-3039e2641f5e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.099121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 534/1075] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:23.099121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.099121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.099121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.112992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:23.114160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:23.119669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.180858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 535/1076] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:23.181691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.193740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dae2-b1f9-4cce-8959-c761bf129abf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.229266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.229927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.230213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.230541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.231329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:23.231642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.233075 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.244452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 542/1077] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:23.245308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.287310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ccf07-78a0-4ae4-83b4-1279091c1811 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.307142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.323224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.324402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.324843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.325124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] PATH_INFO: `/v3/users/291eaeeb966e4888baa8334c0c7921ff` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.326316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] RBAC: Authorizing `identity:get_user(user_id=291eaeeb966e4888baa8334c0c7921ff)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.327771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.329386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 536/1078] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/users/291eaeeb966e4888baa8334c0c7921ff => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:23.330395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.336776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.346560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1c2c9-6526-4e4d-93ed-a73f207203fd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.380457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.381101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.381392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.381670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.431159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cea19-a976-42c1-860d-10a9de5e9eaa None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.449812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.451294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.467561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.468443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.468726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.469011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/a3981687a6c741afbd3d22eb49fe4da7/roles/dc96b5972b6749198fa21417d94cfdbb` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.471525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=a3981687a6c741afbd3d22eb49fe4da7, role_id=dc96b5972b6749198fa21417d94cfdbb)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.472962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.485246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 537/1079] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:33:23 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/a3981687a6c741afbd3d22eb49fe4da7/roles/dc96b5972b6749198fa21417d94cfdbb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:23.486581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.543098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.557562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.573377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 543/1080] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:23.574659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.610107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83db8f-7888-4b75-a0de-54d08217b3c6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.655124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.655363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.655604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.655880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.657069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] RBAC: Authorizing `identity:get_project(project_id=b9b2cd2291104145b22e2fc90080f426)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.659154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.660885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 538/1081] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:23.667082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.698836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317153-1f2f-481a-91b6-8ce33d0391fa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.735150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.736540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.736826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.737114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.747370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.748846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:23.771004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:23.771973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:23.772919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:23.772919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:23.772919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:23.772919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:23.772919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 544/1082] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:23.778731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.780979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175230cb-072b-48e9-b87e-af36e359f1fa None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.799526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.819148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79141f24-138b-4967-97d6-b47ad9afdf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.820053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79141f24-138b-4967-97d6-b47ad9afdf02 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.820343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79141f24-138b-4967-97d6-b47ad9afdf02 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.820745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79141f24-138b-4967-97d6-b47ad9afdf02 None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426/users/291eaeeb966e4888baa8334c0c7921ff/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.822897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79141f24-138b-4967-97d6-b47ad9afdf02 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b2cd2291104145b22e2fc90080f426, user_id=291eaeeb966e4888baa8334c0c7921ff, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.824478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79141f24-138b-4967-97d6-b47ad9afdf02 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.826607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.844106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 539/1083] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:33:23 2022] PUT /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426/users/291eaeeb966e4888baa8334c0c7921ff/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:23.890061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f64a-3c94-4909-99d7-1e72d1256de3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.930201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.930924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.931218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.931499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.932239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:23.932553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.933943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7304b-5632-4932-9e9f-e60dac88ed84 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.954391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 545/1084] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:25.575403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7707729-d126-426a-8255-6c4fd020be5c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.575959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7707729-d126-426a-8255-6c4fd020be5c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.575959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7707729-d126-426a-8255-6c4fd020be5c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.577319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 540/1085] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:25.583326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.583746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.583893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.601444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:25.602667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.668170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 546/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:25.692369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7707729-d126-426a-8255-6c4fd020be5c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.799687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7707729-d126-426a-8255-6c4fd020be5c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.833011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a884b-4a3b-4074-bdef-b650cc00ac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.833926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a884b-4a3b-4074-bdef-b650cc00ac73 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.834211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a884b-4a3b-4074-bdef-b650cc00ac73 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.834525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a884b-4a3b-4074-bdef-b650cc00ac73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.844480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a884b-4a3b-4074-bdef-b650cc00ac73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d91a884b-4a3b-4074-bdef-b650cc00ac73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:25.852772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:25.853936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:25.855164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 541/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 19 15:33:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:25.859923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.893823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:25.914914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6725-1b28-40fc-a874-d25629f3bea2 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.915201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6725-1b28-40fc-a874-d25629f3bea2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.915481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6725-1b28-40fc-a874-d25629f3bea2 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.916847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 542/1088] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:25.921675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.921962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.922241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.939007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:25.940486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.962917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0692bc-d7c1-4aeb-a2e0-dd991be3ac75 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.969448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:25.997745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.998465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.998754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.999036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.999798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:26.000129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.001633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.009256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 543/1089] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:33:26.009541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 547/1090] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:33:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:26.015017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.038668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.113335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac606be9-f752-4e30-89fd-65db3f3a4d74 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.130377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.136560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22024b27-2484-449f-bd11-9fcd0d10c318 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.148150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.148942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.149228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.149506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.160165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.161600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.170953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.171737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.172027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.172312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:26.178917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:26.179828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:26.180756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:26.180756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:26.180756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:26.180756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:26.180756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 544/1091] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:26.183885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:26.185889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:26.192587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:26.193705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:26.194621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 548/1092] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:26.199639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.206167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.286882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ffb94-9c1f-4bd2-b1af-1e80c155a6c4 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.298324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52e43-5680-4b5a-81b5-d15309866a4c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.320488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.321152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.321438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.321719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.322478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:26.322794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.324171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.331699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.332363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.332658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.332945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.333701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:26.334018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.335414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.335757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 545/1093] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:26.341371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.353098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 549/1094] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:26.354117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.373451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.418395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.442004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d40131-9bd3-4e99-8101-11e81132b522 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.460554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26d26-2722-471c-adef-00c0e14fa29a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.476501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.477291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.477577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.477856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.485422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.487020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.494506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.495372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.495667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.495949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] PATH_INFO: `/v3/users/291eaeeb966e4888baa8334c0c7921ff` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.497206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] RBAC: Authorizing `identity:get_user(user_id=291eaeeb966e4888baa8334c0c7921ff)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.498658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.500296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 550/1095] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/users/291eaeeb966e4888baa8334c0c7921ff => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:33:26.500730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:26.501859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:26.503074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 546/1096] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:26.505932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.507758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.590442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.605470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f4b3-8e80-49e9-8650-d8072547a9cf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.606981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19515-80f7-4283-be5d-eff6f8c4a7f3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.640120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.640313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.640720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.640891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.641011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.641179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.641279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.641463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.642609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:26.642933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.644792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.655240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.665858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 547/1097] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:26.674393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.716121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.717582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.771962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed08683-f379-4f2e-a7b2-2eca9cff082a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.803686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.806509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.807167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.807449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.807731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.819930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 551/1098] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:33:26.825880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.869396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.876830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.878298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.925081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc782d9-8173-4fe6-937e-41d57e7842d9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.959048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.959892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.960175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.960456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.961621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] RBAC: Authorizing `identity:get_project(project_id=b9b2cd2291104145b22e2fc90080f426)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.963075 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.964758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 552/1099] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:26.970806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.976827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 548/1100] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:33:26.982380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.025285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.070772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6a0b9-e5d7-46ee-be2b-24cf5b54e5db None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.074767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.081792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59643f4c-ef6d-4510-ac41-fe175f336d75 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.106313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.106982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.107271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.107690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.108523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=b9b2cd2291104145b22e2fc90080f426, user.id=291eaeeb966e4888baa8334c0c7921ff) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:27.108837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.110260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.130391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 553/1101] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/role_assignments?user.id=291eaeeb966e4888baa8334c0c7921ff&scope.project.id=b9b2cd2291104145b22e2fc90080f426&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:27.130637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.130637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.130637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.130637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.130982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.130982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:27.150021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:27.151370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:27.152253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:33:27.152253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:27.152253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:33:27.152253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:27.152253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 549/1102] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:33:27.158136 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.262761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862879-3e5d-439f-a8df-0b3e01734fd8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.281024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.299616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.300290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.300577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.300858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.301586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:27.301901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.303309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.315844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 554/1103] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:27.321816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.427335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796987-de80-4bcc-a1cf-1c80dea9bee5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.460761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.461549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.461836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.462118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.468701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.470222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:33:27.484758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:27.486300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:27.487496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 550/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:27.492375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.590925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f1591-284f-4f27-9b02-6e60d3c43094 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.625841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.626729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.627105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.627391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.628185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:27.628500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.629933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f71a8-f8c6-4bba-b1e7-abc95b87a25c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.641454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 555/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:27.647616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.659980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.748617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8236-e182-4d59-aff0-910c9ef4a813 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.781938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.782815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.783200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.783487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.784315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] RBAC: Adding query filter params (role.id=dc96b5972b6749198fa21417d94cfdbb, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=a3981687a6c741afbd3d22eb49fe4da7) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:27.784629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.786057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db5f6-f373-4493-9adb-432b50edbb4f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.791850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 551/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/role_assignments?user.id=a3981687a6c741afbd3d22eb49fe4da7&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=dc96b5972b6749198fa21417d94cfdbb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:29.196574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94244af-edd7-457a-9f49-b2c2ba390a78 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.197094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94244af-edd7-457a-9f49-b2c2ba390a78 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.197208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94244af-edd7-457a-9f49-b2c2ba390a78 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.198519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 556/1107] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:29.203721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.204121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.204294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.221330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:29.222575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.287795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 552/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:29.312501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94244af-edd7-457a-9f49-b2c2ba390a78 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.353492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:29.413951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94244af-edd7-457a-9f49-b2c2ba390a78 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.446937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214efaab-3da8-46c7-b395-40fa7e0df9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.447667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214efaab-3da8-46c7-b395-40fa7e0df9cb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.447956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214efaab-3da8-46c7-b395-40fa7e0df9cb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.448236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214efaab-3da8-46c7-b395-40fa7e0df9cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.449414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214efaab-3da8-46c7-b395-40fa7e0df9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.450880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214efaab-3da8-46c7-b395-40fa7e0df9cb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.452478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 557/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:29.459053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.461191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:29.556668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5208e93-d627-4662-83e9-334d67f4132f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.589686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b4b72-61f5-45ab-b543-b8e1ccbe28cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.590347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b4b72-61f5-45ab-b543-b8e1ccbe28cc None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.590666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b4b72-61f5-45ab-b543-b8e1ccbe28cc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.590949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b4b72-61f5-45ab-b543-b8e1ccbe28cc None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.591674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b4b72-61f5-45ab-b543-b8e1ccbe28cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.593100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b4b72-61f5-45ab-b543-b8e1ccbe28cc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.612180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 553/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:31.691658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00552-2f4e-4339-bb21-0fca1957f585 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:31.692062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00552-2f4e-4339-bb21-0fca1957f585 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:31.692210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00552-2f4e-4339-bb21-0fca1957f585 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:31.693584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 558/1111] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:31.698891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:31.699290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:31.699463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:31.716554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:31.717735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:31.768713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:31.783674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 554/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:31.807592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00552-2f4e-4339-bb21-0fca1957f585 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:31.906205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00552-2f4e-4339-bb21-0fca1957f585 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:31.913503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:31.940517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:31.941294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:31.941574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:31.941846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] PATH_INFO: `/v3/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:31.943310 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] RBAC: Authorizing `identity:get_role(role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:31.944675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:31.946553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 559/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:31 2022] GET /identity/v3/roles/04c92931c9c541f9af08fe6b22629f71 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:31.952310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:32.047531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528688bd-c79e-4c66-9555-cba94bdd5d83 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:32.083945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:32.084816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:32.085099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:32.085392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] PATH_INFO: `/v3/users/8b58d99190eb438eb0c5c2394b464b29` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:32.101212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] RBAC: Authorizing `identity:get_user(user_id=8b58d99190eb438eb0c5c2394b464b29)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:32.102705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:32.104381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 555/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:31 2022] GET /identity/v3/users/8b58d99190eb438eb0c5c2394b464b29 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:32.110186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:32.206127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032075d-52a9-4cab-8869-443d2d77b9ee None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:32.237805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:32.238466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:32.238756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:32.239036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:32.282023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:32.306316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:32.307798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:32.403032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 560/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:32.409572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:32.457933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:32.509538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6edd2-d8af-4d90-8c0a-230d87e94d20 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:32.543526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de04096-0f31-423e-b025-742c154e4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:32.544376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de04096-0f31-423e-b025-742c154e4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:32.544663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de04096-0f31-423e-b025-742c154e4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:32.544944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de04096-0f31-423e-b025-742c154e4bc9 None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:32.546121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de04096-0f31-423e-b025-742c154e4bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b2cd2291104145b22e2fc90080f426)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:32.547581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de04096-0f31-423e-b025-742c154e4bc9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:32.549341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 556/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:32 2022] GET /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:32.555509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:32.626740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:32.651199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38158e-a84e-4fca-a5d7-3b0b0951838c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:32.686094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:32.686775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:32.687059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:32.687333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:32.688152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] RBAC: Adding query filter params (role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=b9b2cd2291104145b22e2fc90080f426, user.id=8b58d99190eb438eb0c5c2394b464b29) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:32.688462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:32.690779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d1987-8898-435e-823e-c777d1451255 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:32.696065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 561/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:32 2022] GET /identity/v3/role_assignments?user.id=8b58d99190eb438eb0c5c2394b464b29&scope.project.id=b9b2cd2291104145b22e2fc90080f426&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:34.721411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4a5d1-55de-41e5-9f73-c7c873797d3c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.721883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4a5d1-55de-41e5-9f73-c7c873797d3c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.722005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4a5d1-55de-41e5-9f73-c7c873797d3c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.723475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 557/1118] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:34.728564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.728943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.729133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.747271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:34.748456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:34.819619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 562/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:34.841979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4a5d1-55de-41e5-9f73-c7c873797d3c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:34.942468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4a5d1-55de-41e5-9f73-c7c873797d3c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:34.956063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:34.975676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:34.976527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.976815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.977096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] PATH_INFO: `/v3/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.978607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] RBAC: Authorizing `identity:get_role(role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:34.979978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:34.981356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 558/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:34 2022] GET /identity/v3/roles/04c92931c9c541f9af08fe6b22629f71 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:34.988219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:35.051831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:35.084277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2c721-c129-4ed9-8445-ccaba2c41132 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:35.116762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:35.117608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:35.117889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:35.118163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] PATH_INFO: `/v3/users/8b58d99190eb438eb0c5c2394b464b29` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:35.119353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] RBAC: Authorizing `identity:get_user(user_id=8b58d99190eb438eb0c5c2394b464b29)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:35.120768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:35.122381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 563/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:34 2022] GET /identity/v3/users/8b58d99190eb438eb0c5c2394b464b29 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:35.128638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:35.226262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494f498-f072-42de-b161-ef4dfad490fe None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:35.259110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855959-1e67-4448-8ecb-e3f1c0b69f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:35.259961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855959-1e67-4448-8ecb-e3f1c0b69f73 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:35.260246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855959-1e67-4448-8ecb-e3f1c0b69f73 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:35.260530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855959-1e67-4448-8ecb-e3f1c0b69f73 None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:35.261697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855959-1e67-4448-8ecb-e3f1c0b69f73 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b2cd2291104145b22e2fc90080f426)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:35.263142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855959-1e67-4448-8ecb-e3f1c0b69f73 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:35.264820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 559/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:35 2022] GET /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:35.271625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:35.375355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed89e59-ac51-4f35-ae9b-d82c69b9fb9a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:35.408431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400cf0e-39ac-40ab-8549-91593f4d1368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:35.409308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400cf0e-39ac-40ab-8549-91593f4d1368 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:35.409595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400cf0e-39ac-40ab-8549-91593f4d1368 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:35.409876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400cf0e-39ac-40ab-8549-91593f4d1368 None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426/users/8b58d99190eb438eb0c5c2394b464b29/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:35.412102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400cf0e-39ac-40ab-8549-91593f4d1368 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b2cd2291104145b22e2fc90080f426, user_id=8b58d99190eb438eb0c5c2394b464b29, role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:35.413553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400cf0e-39ac-40ab-8549-91593f4d1368 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:35.417093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:35.431477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 564/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:33:35 2022] PUT /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426/users/8b58d99190eb438eb0c5c2394b464b29/roles/04c92931c9c541f9af08fe6b22629f71 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:37.473848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7274e-d366-45c7-ae81-684f7f22a817 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.474455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7274e-d366-45c7-ae81-684f7f22a817 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.474455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7274e-d366-45c7-ae81-684f7f22a817 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.475806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 560/1124] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:37.481407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.481856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.481970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.500351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:37.501774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:37.566319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 565/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:37.589710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7274e-d366-45c7-ae81-684f7f22a817 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.640492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:37.691787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7274e-d366-45c7-ae81-684f7f22a817 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.725435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.726217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.726535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.726816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] PATH_INFO: `/v3/roles/04c92931c9c541f9af08fe6b22629f71` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.728286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] RBAC: Authorizing `identity:get_role(role_id=04c92931c9c541f9af08fe6b22629f71)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.729667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.731068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 561/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:37 2022] GET /identity/v3/roles/04c92931c9c541f9af08fe6b22629f71 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:37.736972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.833668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378202a-3690-4076-9199-cb92b36a7dc5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.858746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:37.867819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.868686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.868970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.869247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] PATH_INFO: `/v3/users/8b58d99190eb438eb0c5c2394b464b29` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.870451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] RBAC: Authorizing `identity:get_user(user_id=8b58d99190eb438eb0c5c2394b464b29)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.871884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.873504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 566/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:37 2022] GET /identity/v3/users/8b58d99190eb438eb0c5c2394b464b29 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:37.879277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.977557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce464-2597-4a40-b08a-3fc5935427f6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.995095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:38.012782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.013423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.013710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.013989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.080879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.082317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.178963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 562/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:38.184884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.282990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb35579-54ce-4da0-8c51-2edb489501b9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.316010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce46a1-aaf7-4ddb-abdd-f469dfaea19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.316861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce46a1-aaf7-4ddb-abdd-f469dfaea19f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.317152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce46a1-aaf7-4ddb-abdd-f469dfaea19f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.317434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce46a1-aaf7-4ddb-abdd-f469dfaea19f None admin] PATH_INFO: `/v3/projects/b9b2cd2291104145b22e2fc90080f426` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.318639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce46a1-aaf7-4ddb-abdd-f469dfaea19f None admin] RBAC: Authorizing `identity:get_project(project_id=b9b2cd2291104145b22e2fc90080f426)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.320073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce46a1-aaf7-4ddb-abdd-f469dfaea19f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.321757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 567/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:38 2022] GET /identity/v3/projects/b9b2cd2291104145b22e2fc90080f426 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:38.327794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.346964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:38.430653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82b18d-8b80-4345-b6ef-c199b150e68e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.463939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.464582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.464871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.465155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.465987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] RBAC: Adding query filter params (role.id=04c92931c9c541f9af08fe6b22629f71, scope.project.id=b9b2cd2291104145b22e2fc90080f426, user.id=8b58d99190eb438eb0c5c2394b464b29) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:38.466305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.467760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a1ebe-f8c1-4c32-8f45-11ec78f2e88c None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.473739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 563/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:38 2022] GET /identity/v3/role_assignments?user.id=8b58d99190eb438eb0c5c2394b464b29&scope.project.id=b9b2cd2291104145b22e2fc90080f426&role.id=04c92931c9c541f9af08fe6b22629f71 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:40.531064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465baa-ea6d-4b79-b848-3a6ef3f3efc4 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:40.531622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465baa-ea6d-4b79-b848-3a6ef3f3efc4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:40.531622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465baa-ea6d-4b79-b848-3a6ef3f3efc4 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:40.533078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 568/1131] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:40.538189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:40.538630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:40.538797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:40.555296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:40.556466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:40.621467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 564/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:40.645406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d465baa-ea6d-4b79-b848-3a6ef3f3efc4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:40.707653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:40.746685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d465baa-ea6d-4b79-b848-3a6ef3f3efc4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:40.780097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7922e-1262-47b2-b79a-60e82260c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:40.780887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7922e-1262-47b2-b79a-60e82260c3ee None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:40.781225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7922e-1262-47b2-b79a-60e82260c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:40.781458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7922e-1262-47b2-b79a-60e82260c3ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:40.782907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7922e-1262-47b2-b79a-60e82260c3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:40.784411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7922e-1262-47b2-b79a-60e82260c3ee None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:40.786032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 569/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:40.792008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:40.806372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:40.888412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c5df3-1cea-45a1-861e-b9045a345f1e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:40.921639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb25df-581d-4313-9eec-f00ee9a3ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:40.922297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb25df-581d-4313-9eec-f00ee9a3ab42 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:40.922612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb25df-581d-4313-9eec-f00ee9a3ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:40.922897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb25df-581d-4313-9eec-f00ee9a3ab42 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:40.923827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb25df-581d-4313-9eec-f00ee9a3ab42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:40.925252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb25df-581d-4313-9eec-f00ee9a3ab42 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:40.949018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 565/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:33:40 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:43.025281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad859f-76ac-41eb-97ba-eabab3f9c24d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.025783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad859f-76ac-41eb-97ba-eabab3f9c24d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.025783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad859f-76ac-41eb-97ba-eabab3f9c24d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.027538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 570/1135] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:43.033470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.033910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.034064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.050846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:43.052048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.108718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.117656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 566/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:43.142577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad859f-76ac-41eb-97ba-eabab3f9c24d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.244331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad859f-76ac-41eb-97ba-eabab3f9c24d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.272831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.280596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4fa6c-6e7b-4404-b53c-4552b8c3a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.281331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4fa6c-6e7b-4404-b53c-4552b8c3a888 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.281614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4fa6c-6e7b-4404-b53c-4552b8c3a888 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.281892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4fa6c-6e7b-4404-b53c-4552b8c3a888 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.283210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4fa6c-6e7b-4404-b53c-4552b8c3a888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.284643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4fa6c-6e7b-4404-b53c-4552b8c3a888 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.286260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 571/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:33:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:43.291991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.386678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3f4c-b8f1-4091-ba06-bfda8954a308 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.419231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0c814-e3c8-4d2d-a203-64ea0a6cb6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.419886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0c814-e3c8-4d2d-a203-64ea0a6cb6e6 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.420167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0c814-e3c8-4d2d-a203-64ea0a6cb6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.420443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0c814-e3c8-4d2d-a203-64ea0a6cb6e6 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.421148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0c814-e3c8-4d2d-a203-64ea0a6cb6e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.422607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0c814-e3c8-4d2d-a203-64ea0a6cb6e6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.442443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 567/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:33:43 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:45.510906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b7fd7-48f0-4fbd-b4f9-682070078a58 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.511455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b7fd7-48f0-4fbd-b4f9-682070078a58 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.511455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b7fd7-48f0-4fbd-b4f9-682070078a58 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.512813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 572/1139] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:45.518239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.518673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.518841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.535493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:45.536682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:45.581978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:45.603994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 568/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:45.628814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b7fd7-48f0-4fbd-b4f9-682070078a58 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.739187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b7fd7-48f0-4fbd-b4f9-682070078a58 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.772649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.773367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.773657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.773940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.784495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:45.792152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:45.793261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:45.794329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 573/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:45.799568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.896883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcdead-5349-4b27-baa5-affc4386d2ab None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.931290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.931953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.932240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.932522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.933268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:45.933581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.934997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.943067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 569/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:45.948916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:46.011309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:46.053117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12bf2-db97-4013-a590-e57693cbd9af None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:46.086266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:46.087171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:46.087457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:46.087735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] PATH_INFO: `/v3/users/b6f97ec4dc46443ba4251e775418d674` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:46.102719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f97ec4dc46443ba4251e775418d674)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:46.104169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:46.105841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 574/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:45 2022] GET /identity/v3/users/b6f97ec4dc46443ba4251e775418d674 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:46.112271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:46.154466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:46.209193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba25c-5536-42c5-a77f-ced94e884485 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:46.240875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:46.241511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:46.241793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:46.242071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:46.307133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:46.308513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:46.348326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:46.403940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 570/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:46.410446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:46.506993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb568-5896-49f7-a29f-d97780459b75 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:46.522952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:46.541399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50f20-f4f7-4146-bb11-132a94c3d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:46.542257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50f20-f4f7-4146-bb11-132a94c3d563 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:46.542578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50f20-f4f7-4146-bb11-132a94c3d563 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:46.542857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50f20-f4f7-4146-bb11-132a94c3d563 None admin] PATH_INFO: `/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:46.544032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50f20-f4f7-4146-bb11-132a94c3d563 None admin] RBAC: Authorizing `identity:get_project(project_id=be8ac81bc56f4ef4b67b11133e9adefc)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:46.545463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50f20-f4f7-4146-bb11-132a94c3d563 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:46.547190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 575/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:46 2022] GET /identity/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:46.554053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:46.651531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602ea05-fd4c-4285-974d-9db8fddda088 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:46.684732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:46.685389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:46.685678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:46.685963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:46.686839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=be8ac81bc56f4ef4b67b11133e9adefc, user.id=b6f97ec4dc46443ba4251e775418d674) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:46.687157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:46.689169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637a11a-e2c5-4517-b888-cce0c719d2d0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:46.697042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 571/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:46 2022] GET /identity/v3/role_assignments?user.id=b6f97ec4dc46443ba4251e775418d674&scope.project.id=be8ac81bc56f4ef4b67b11133e9adefc&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:48.715924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931b44-d2d7-4349-a6f8-033c020dfa7c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.716416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931b44-d2d7-4349-a6f8-033c020dfa7c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.716510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931b44-d2d7-4349-a6f8-033c020dfa7c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.717841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 576/1147] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:48.722995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.723405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.723551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.734989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:48.740203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:48.741379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:48.809522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 572/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:48.833068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931b44-d2d7-4349-a6f8-033c020dfa7c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.931347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931b44-d2d7-4349-a6f8-033c020dfa7c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.964105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.964817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.965100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.965375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.975197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:48.982744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:48.983651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:48.984615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 577/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:48.990718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.086257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554707db-f871-4ef6-92f0-0f6bee71099a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.120078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.120744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.121035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.121340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.122088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:49.122433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.123805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.126645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:49.133289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 573/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:49.139058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.183748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:49.236011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3027-6993-4190-9a1b-f26ea7a21253 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.267657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.268515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.268799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.269073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] PATH_INFO: `/v3/users/b6f97ec4dc46443ba4251e775418d674` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.270298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] RBAC: Authorizing `identity:get_user(user_id=b6f97ec4dc46443ba4251e775418d674)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.272417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.274366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 578/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:49 2022] GET /identity/v3/users/b6f97ec4dc46443ba4251e775418d674 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:49.281992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.380177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded2c2-766f-4430-bb18-506a93443407 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.412747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2c8fc-fb33-426d-a50b-dc78d6d149fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.413591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2c8fc-fb33-426d-a50b-dc78d6d149fe None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.413881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2c8fc-fb33-426d-a50b-dc78d6d149fe None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.414167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2c8fc-fb33-426d-a50b-dc78d6d149fe None admin] PATH_INFO: `/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.415379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2c8fc-fb33-426d-a50b-dc78d6d149fe None admin] RBAC: Authorizing `identity:get_project(project_id=be8ac81bc56f4ef4b67b11133e9adefc)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.416811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2c8fc-fb33-426d-a50b-dc78d6d149fe None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.418523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 574/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:49 2022] GET /identity/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:49.425354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.521560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fec6c2-fd9e-46b4-9285-27a42d5f812e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.534431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:49.555511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9436fd9-dd65-4745-9279-a14e14b40771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.556388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9436fd9-dd65-4745-9279-a14e14b40771 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.556673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9436fd9-dd65-4745-9279-a14e14b40771 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.556952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9436fd9-dd65-4745-9279-a14e14b40771 None admin] PATH_INFO: `/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc/users/b6f97ec4dc46443ba4251e775418d674/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.558939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9436fd9-dd65-4745-9279-a14e14b40771 None admin] RBAC: Authorizing `identity:create_grant(project_id=be8ac81bc56f4ef4b67b11133e9adefc, user_id=b6f97ec4dc46443ba4251e775418d674, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.560360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9436fd9-dd65-4745-9279-a14e14b40771 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.573090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 579/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:33:49 2022] PUT /identity/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc/users/b6f97ec4dc46443ba4251e775418d674/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:51.581732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587aa58-e76a-492a-bad1-63f5b8c34d4c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:51.582263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587aa58-e76a-492a-bad1-63f5b8c34d4c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:51.582388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587aa58-e76a-492a-bad1-63f5b8c34d4c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:51.583698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 575/1154] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:51.588786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:51.589233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:51.589335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:51.606595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:51.607781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:51.675609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 580/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:51.699317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587aa58-e76a-492a-bad1-63f5b8c34d4c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:51.764292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:51.799889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587aa58-e76a-492a-bad1-63f5b8c34d4c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:51.832801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:51.833513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:51.833797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:51.834074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:51.843769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:33:51.851392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:51.852542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:33:51.853838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 576/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:51.858604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:51.956876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f6fc0-8411-4248-bac5-6fea18091998 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:51.958345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:51.992274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:51.992930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:51.993212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:51.993490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:51.994226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:51.994573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:51.995930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:52.004505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 581/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:52.010279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:52.107063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a8ec1-0a99-4dfb-b98a-abb5a8ed81c7 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:52.133201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:52.141846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:52.142731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:52.143016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:52.143334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] PATH_INFO: `/v3/users/b6f97ec4dc46443ba4251e775418d674` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:52.144515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] RBAC: Authorizing `identity:get_user(user_id=b6f97ec4dc46443ba4251e775418d674)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:52.145941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:52.147629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 577/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:33:52 2022] GET /identity/v3/users/b6f97ec4dc46443ba4251e775418d674 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:52.153601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:52.249416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f73e6a-4455-4664-abb5-dbff3b4be23a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:52.284146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:52.284875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:52.285176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:52.285491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:52.317016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:52.353131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:52.354607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:52.449982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 582/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:52.455934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:52.553542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6806-9555-42e2-873e-dbdc4c78908a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:52.586351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82c0cc-a052-4986-85d6-5e18c8317e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:52.587216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c0cc-a052-4986-85d6-5e18c8317e3e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:52.587498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c0cc-a052-4986-85d6-5e18c8317e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:52.587773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c0cc-a052-4986-85d6-5e18c8317e3e None admin] PATH_INFO: `/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:52.588930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82c0cc-a052-4986-85d6-5e18c8317e3e None admin] RBAC: Authorizing `identity:get_project(project_id=be8ac81bc56f4ef4b67b11133e9adefc)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:52.590377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82c0cc-a052-4986-85d6-5e18c8317e3e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:52.592052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 578/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:33:52 2022] GET /identity/v3/projects/be8ac81bc56f4ef4b67b11133e9adefc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:52.598064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:52.663421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:52.701190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0481a-281d-4149-9259-db8611a12064 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:52.733631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:52.734272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:52.734584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:52.734863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:52.736284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=be8ac81bc56f4ef4b67b11133e9adefc, user.id=b6f97ec4dc46443ba4251e775418d674) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:52.736597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:52.738014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa3b2-1857-4dbb-bfe8-fb36c53770e9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:52.743637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 583/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:33:52 2022] GET /identity/v3/role_assignments?user.id=b6f97ec4dc46443ba4251e775418d674&scope.project.id=be8ac81bc56f4ef4b67b11133e9adefc&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:54.794702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c0ac-e325-414a-9ea7-ea415d2c2ed3 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:54.795240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c0ac-e325-414a-9ea7-ea415d2c2ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:54.795240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c0ac-e325-414a-9ea7-ea415d2c2ed3 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:54.796627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 579/1162] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:54.803486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:54.803983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:54.804281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:54.821959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:54.823180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:54.887794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 584/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:54.911442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c0ac-e325-414a-9ea7-ea415d2c2ed3 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:54.972621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:55.012215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c0ac-e325-414a-9ea7-ea415d2c2ed3 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:55.046490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:55.047139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.047458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.048281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.114037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:55.115513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:55.174325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:55.213519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 580/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:33:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:55.219543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:55.275812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:55.320423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c12bb-79b0-4410-bfa3-b154185853e3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:55.354229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:55.355054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.355343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.355626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.362268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:55.363742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-2668d032-139d-4a9f-9f4c-4afcadc098e8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:33:55.378925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:33:55.380127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:33:55.381341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 585/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:33:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:33:55.386104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:55.482216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4444-f116-4e5e-8e52-3da2a9e8a984 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:55.515521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:55.516176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.517100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.517525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.518254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:55.518603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:55.519970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5034d00-dac8-48f2-92ed-d6425ff539cb None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:55.527227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 581/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 19 15:33:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:57.564714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f426e-fc97-4e1e-933c-4d5b11af3a4a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:57.565390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f426e-fc97-4e1e-933c-4d5b11af3a4a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:57.565390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f426e-fc97-4e1e-933c-4d5b11af3a4a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:57.566680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 586/1167] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:33:57.571869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052670ec-b195-4956-bde6-3844b05f557c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:57.572320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052670ec-b195-4956-bde6-3844b05f557c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:57.572431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052670ec-b195-4956-bde6-3844b05f557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:57.588972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-052670ec-b195-4956-bde6-3844b05f557c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:57.590141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-052670ec-b195-4956-bde6-3844b05f557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:57.610039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:57.655351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 582/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:57.678916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f426e-fc97-4e1e-933c-4d5b11af3a4a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:57.777242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f426e-fc97-4e1e-933c-4d5b11af3a4a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:57.794106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:57.811112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826c176-b8e6-4a5c-a719-e4788d5f0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:57.811761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c176-b8e6-4a5c-a719-e4788d5f0410 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:57.812044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c176-b8e6-4a5c-a719-e4788d5f0410 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:57.812318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c176-b8e6-4a5c-a719-e4788d5f0410 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:57.813045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826c176-b8e6-4a5c-a719-e4788d5f0410 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:57.814637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826c176-b8e6-4a5c-a719-e4788d5f0410 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:57.828630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 587/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Tue Jul 19 15:33:57 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:59.863701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688a8b-7d4e-46ba-9ff0-8aad94a4bc78 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:59.864244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688a8b-7d4e-46ba-9ff0-8aad94a4bc78 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:59.864244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688a8b-7d4e-46ba-9ff0-8aad94a4bc78 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:59.865629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 583/1170] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:59.870702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:59.871086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:59.871267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:59.888431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:59.889603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:59.953690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 588/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:33:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:33:59.976550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688a8b-7d4e-46ba-9ff0-8aad94a4bc78 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:00.074612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688a8b-7d4e-46ba-9ff0-8aad94a4bc78 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:00.107265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0443ae5-5bb2-4d49-9121-4a791a787d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:00.108115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0443ae5-5bb2-4d49-9121-4a791a787d0e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:00.108401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0443ae5-5bb2-4d49-9121-4a791a787d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:00.108676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0443ae5-5bb2-4d49-9121-4a791a787d0e None admin] PATH_INFO: `/v3/domains/f856fadc20cf4248a706da011e9441c0` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:00.119372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0443ae5-5bb2-4d49-9121-4a791a787d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=f856fadc20cf4248a706da011e9441c0)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:00.120818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0443ae5-5bb2-4d49-9121-4a791a787d0e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:00.122459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 584/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Tue Jul 19 15:33:59 2022] GET /identity/v3/domains/f856fadc20cf4248a706da011e9441c0 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:00.128371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:00.226030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef73f9-1303-4c91-971d-a7ea4032c11d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:00.234824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:00.260825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93434e1-0d47-41d5-b4b0-7db56ae26f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:00.261484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93434e1-0d47-41d5-b4b0-7db56ae26f24 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:00.261774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93434e1-0d47-41d5-b4b0-7db56ae26f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:00.262055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93434e1-0d47-41d5-b4b0-7db56ae26f24 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:00.262815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93434e1-0d47-41d5-b4b0-7db56ae26f24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:00.264259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93434e1-0d47-41d5-b4b0-7db56ae26f24 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:00.290372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 589/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:34:00 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:02.359378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3111f65-762a-4fb3-970f-e1a59c0ff85d None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.359925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3111f65-762a-4fb3-970f-e1a59c0ff85d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.359925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3111f65-762a-4fb3-970f-e1a59c0ff85d None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.361298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 585/1174] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:34:02.366941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.367365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.367523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.384606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:02.385799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:02.451955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 590/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:34:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:34:02.477560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3111f65-762a-4fb3-970f-e1a59c0ff85d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.495612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:02.576002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3111f65-762a-4fb3-970f-e1a59c0ff85d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.609126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3de7-50e3-46e2-9054-739b91f0e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.610018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3de7-50e3-46e2-9054-739b91f0e815 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.610250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3de7-50e3-46e2-9054-739b91f0e815 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.610548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3de7-50e3-46e2-9054-739b91f0e815 None admin] PATH_INFO: `/v3/domains/f856fadc20cf4248a706da011e9441c0` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.611755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3de7-50e3-46e2-9054-739b91f0e815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f856fadc20cf4248a706da011e9441c0)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.613255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3de7-50e3-46e2-9054-739b91f0e815 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.614892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 586/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Tue Jul 19 15:34:02 2022] GET /identity/v3/domains/f856fadc20cf4248a706da011e9441c0 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:02.620703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.712354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:02.723700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b96b-f811-49cb-893e-2cdb73b9e34a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.755972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b859ec-9874-4272-8bbc-15a8a00c377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.756641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b859ec-9874-4272-8bbc-15a8a00c377f None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.756929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b859ec-9874-4272-8bbc-15a8a00c377f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.757213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b859ec-9874-4272-8bbc-15a8a00c377f None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.757923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b859ec-9874-4272-8bbc-15a8a00c377f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.759503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b859ec-9874-4272-8bbc-15a8a00c377f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.779209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 591/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:34:02 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:04.867896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396d6f1-4e35-446c-8325-c38fc48fef87 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.868442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396d6f1-4e35-446c-8325-c38fc48fef87 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.868442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396d6f1-4e35-446c-8325-c38fc48fef87 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.869812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 587/1178] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:34:04.875035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.875468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.875601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.892094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:04.893835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:04.958977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 592/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:34:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:34:04.982813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396d6f1-4e35-446c-8325-c38fc48fef87 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.065354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:05.081996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396d6f1-4e35-446c-8325-c38fc48fef87 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.114109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.114918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.115206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.115486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.125233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:34:05.133381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:34:05.134605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:34:05.135898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 588/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:34:05.140588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.214980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:05.239053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0d144-ac8c-4cba-b853-65947fa94b20 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.272168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.272828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.273110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.273387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.274127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:05.274470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:05.275826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:05.283966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 593/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:05.289693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.386945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e921e17-5ca7-4679-8183-0dc3f875d0c2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.420064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.420916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.421199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.421474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] PATH_INFO: `/v3/users/96ce60feff1f4408b0add946d6136c95` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.434084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] RBAC: Authorizing `identity:get_user(user_id=96ce60feff1f4408b0add946d6136c95)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:05.435547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:05.437178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 589/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/users/96ce60feff1f4408b0add946d6136c95 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:05.443553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.544953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dee94b-ae88-405a-adc9-140d842771cc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.577657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.578293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.578609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.578892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.587241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:05.645481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:05.646962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:05.742446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 594/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:34:05.748290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.751143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:05.846311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe38c20-6f3c-4cce-ac29-d9ba210838a1 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.878764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09530e6-4391-4cd9-8f28-b71c01d3ac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.879608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09530e6-4391-4cd9-8f28-b71c01d3ac16 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.879888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09530e6-4391-4cd9-8f28-b71c01d3ac16 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.880162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09530e6-4391-4cd9-8f28-b71c01d3ac16 None admin] PATH_INFO: `/v3/projects/c9b996abce3145f29bb7214441ab42c3` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.881393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09530e6-4391-4cd9-8f28-b71c01d3ac16 None admin] RBAC: Authorizing `identity:get_project(project_id=c9b996abce3145f29bb7214441ab42c3)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:05.882869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09530e6-4391-4cd9-8f28-b71c01d3ac16 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:05.884536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 590/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/projects/c9b996abce3145f29bb7214441ab42c3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:05.890727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.929765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:05.987974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c80d-ec9c-4f0a-880f-d80e466d65cd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:06.021825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:06.022499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:06.022786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:06.023068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:06.023895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=c9b996abce3145f29bb7214441ab42c3, user.id=96ce60feff1f4408b0add946d6136c95) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:06.024213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:06.025641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95b7f-8b52-467a-a5ad-24a8cf0ed5db None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:06.031202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 595/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/role_assignments?user.id=96ce60feff1f4408b0add946d6136c95&scope.project.id=c9b996abce3145f29bb7214441ab42c3&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:08.066626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d702de7-c750-48aa-a16a-5e4571ab6313 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.067141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d702de7-c750-48aa-a16a-5e4571ab6313 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.067141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d702de7-c750-48aa-a16a-5e4571ab6313 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.068482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 591/1186] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:34:08.073549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.073966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.074119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.090747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:08.091936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:08.156910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 596/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:34:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:34:08.180442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d702de7-c750-48aa-a16a-5e4571ab6313 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:08.249547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:08.280804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d702de7-c750-48aa-a16a-5e4571ab6313 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:08.314952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:08.315733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.316020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.316301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.326226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:34:08.334092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:34:08.335295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:34:08.336328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 592/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:34:08.341435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:08.371970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:08.442569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b8ce-3770-446f-b850-0e7c49ebf20e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:08.476359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:08.477026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.477315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.477600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.478344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:08.478688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:08.480063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:08.488114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 597/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:08.493956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:08.590021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2ebbb-1522-4743-975f-f0c3681c11c3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:08.618556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:08.624674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:08.625537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.625825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.626106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] PATH_INFO: `/v3/users/96ce60feff1f4408b0add946d6136c95` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.627534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=96ce60feff1f4408b0add946d6136c95)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:08.628964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:08.630630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 593/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:34:08 2022] GET /identity/v3/users/96ce60feff1f4408b0add946d6136c95 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:08.636531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:08.729570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:08.736562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427c529-3134-4f1e-8f77-bd103726eb0f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:08.769538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275562c-2eda-4ac8-ae87-42a25de528bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:08.770421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275562c-2eda-4ac8-ae87-42a25de528bd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.770711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275562c-2eda-4ac8-ae87-42a25de528bd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.770990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275562c-2eda-4ac8-ae87-42a25de528bd None admin] PATH_INFO: `/v3/projects/c9b996abce3145f29bb7214441ab42c3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.772174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275562c-2eda-4ac8-ae87-42a25de528bd None admin] RBAC: Authorizing `identity:get_project(project_id=c9b996abce3145f29bb7214441ab42c3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:08.773596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275562c-2eda-4ac8-ae87-42a25de528bd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:08.775324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 598/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:34:08 2022] GET /identity/v3/projects/c9b996abce3145f29bb7214441ab42c3 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:08.781518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:08.880845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e522f-b8d1-46bc-b728-6ebbdaf99ae2 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:08.913827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32d1d-40d4-49c4-8cb9-7a069abb6e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:08.914738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32d1d-40d4-49c4-8cb9-7a069abb6e86 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:08.915024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32d1d-40d4-49c4-8cb9-7a069abb6e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:08.915305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32d1d-40d4-49c4-8cb9-7a069abb6e86 None admin] PATH_INFO: `/v3/projects/c9b996abce3145f29bb7214441ab42c3/users/96ce60feff1f4408b0add946d6136c95/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:08.917265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe32d1d-40d4-49c4-8cb9-7a069abb6e86 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9b996abce3145f29bb7214441ab42c3, user_id=96ce60feff1f4408b0add946d6136c95, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:08.918727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe32d1d-40d4-49c4-8cb9-7a069abb6e86 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:08.931015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 594/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:34:08 2022] PUT /identity/v3/projects/c9b996abce3145f29bb7214441ab42c3/users/96ce60feff1f4408b0add946d6136c95/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:10.965007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875a64-e840-4c9e-9d7f-4cb50ebbb7ad None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.965507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875a64-e840-4c9e-9d7f-4cb50ebbb7ad None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.965507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875a64-e840-4c9e-9d7f-4cb50ebbb7ad None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.966896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 599/1193] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:34:10.972224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.972618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.972795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.991943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:10.993279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:11.046252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.060600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 595/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:34:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:34:11.084629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875a64-e840-4c9e-9d7f-4cb50ebbb7ad None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.184029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875a64-e840-4c9e-9d7f-4cb50ebbb7ad None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.216528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.217246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.217533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.217814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.228376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:34:11.236129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:34:11.237745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:34:11.238671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 600/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:34:11.243906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.340218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ad5c-57dd-40a4-a7d6-ab8427c81983 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.374674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.375335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.375618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.375896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.376644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:11.377047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:11.378547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:11.386424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 596/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:11.392374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.417891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.493113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2dd6d-73dc-4b28-9f6f-2736fe53e115 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.525580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.526736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.527024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.527304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] PATH_INFO: `/v3/users/96ce60feff1f4408b0add946d6136c95` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.528487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] RBAC: Authorizing `identity:get_user(user_id=96ce60feff1f4408b0add946d6136c95)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:11.529914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:11.531589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 601/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 19 15:34:11 2022] GET /identity/v3/users/96ce60feff1f4408b0add946d6136c95 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:11.538245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.586270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.634729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e795-b424-4eaa-b7d6-19dcf20b0000 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.667388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.668032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.668319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.668602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.736813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:11.738249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:11.785215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.834960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 597/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:34:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:34:11.840986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.929699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.939747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe8acd-5b9d-4a00-b8bc-c2a5fcd3d3fd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.971871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dd0b9-feb2-4a5c-88f9-c98d092e328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.972719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dd0b9-feb2-4a5c-88f9-c98d092e328b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.973004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dd0b9-feb2-4a5c-88f9-c98d092e328b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.973283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dd0b9-feb2-4a5c-88f9-c98d092e328b None admin] PATH_INFO: `/v3/projects/c9b996abce3145f29bb7214441ab42c3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.974495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dd0b9-feb2-4a5c-88f9-c98d092e328b None admin] RBAC: Authorizing `identity:get_project(project_id=c9b996abce3145f29bb7214441ab42c3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:11.975923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dd0b9-feb2-4a5c-88f9-c98d092e328b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:11.977597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 602/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 19 15:34:11 2022] GET /identity/v3/projects/c9b996abce3145f29bb7214441ab42c3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:11.983793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:12.081593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5960e-3a0e-4d1f-90b9-4692bbf7cf6b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:12.113960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:12.114701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.114985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.115262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.116086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=c9b996abce3145f29bb7214441ab42c3, user.id=96ce60feff1f4408b0add946d6136c95) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:12.116398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:12.117816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4d18-37ba-43dd-a585-43be346187ba None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:12.123626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 598/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:34:11 2022] GET /identity/v3/role_assignments?user.id=96ce60feff1f4408b0add946d6136c95&scope.project.id=c9b996abce3145f29bb7214441ab42c3&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:21.967493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=21 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:22.121000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=93 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:07.987424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6908482-6b92-42f7-8442-8e54e7a429f1 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:07.987972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6908482-6b92-42f7-8442-8e54e7a429f1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:07.987972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6908482-6b92-42f7-8442-8e54e7a429f1 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:07.989561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 603/1201] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:07.995684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:07.996110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:07.996329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:08.014705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:08.016306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:08.113721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 599/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:08.141182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6908482-6b92-42f7-8442-8e54e7a429f1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:08.285540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6908482-6b92-42f7-8442-8e54e7a429f1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:08.332511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:08.333518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:08.333760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:08.334174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:08.351646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:08.353331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:08.377505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:08.378787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:08.379753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:08.379753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:08.379753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:08.379753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:08.379753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 604/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:08.385667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:08.517328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa7b4e-5762-4ca5-a499-1dc1e5c1a8f1 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:08.556321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:08.571654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:08.572326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:08.572615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:08.572905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:08.573643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:08.573956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:08.575392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaba4ff-4e90-4f11-84a6-3a2821ae59fa None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:08.588555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 600/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:08.594250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:08.662462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:08.738321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a61bc-bc7f-4a96-87c8-a4a0b5b6f709 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:08.786650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c430c9f-bf42-499e-ae95-a3dfad1ea039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:08.787428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c430c9f-bf42-499e-ae95-a3dfad1ea039 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:08.787754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c430c9f-bf42-499e-ae95-a3dfad1ea039 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:08.788013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c430c9f-bf42-499e-ae95-a3dfad1ea039 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:08.788710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c430c9f-bf42-499e-ae95-a3dfad1ea039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:08.790153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c430c9f-bf42-499e-ae95-a3dfad1ea039 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:08.824342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 605/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 19 15:35:08 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:11.270800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26737a-2123-4731-ac51-283201480a24 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.271395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26737a-2123-4731-ac51-283201480a24 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.271395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26737a-2123-4731-ac51-283201480a24 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.272699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 601/1206] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:11.279498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.279918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.280115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.306840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:11.308803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:11.395292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 606/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:35:11.423855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26737a-2123-4731-ac51-283201480a24 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:11.549877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26737a-2123-4731-ac51-283201480a24 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:11.586995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:11.587804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.588092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.588373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.600003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:35:11.607762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:11.617612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:11.619326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 602/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:11.622094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:11.672828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:11.752516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910927e3-5623-42dd-87a3-8d1834f40a27 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:11.791084 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:11.791835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.792041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.792376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.793141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:11.793380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:11.794794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:11.804319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 607/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:35:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:11.810001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:11.875139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:11.943290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf33c-caa1-43e0-b9b2-23ee8fcebb29 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:11.981277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:11.982252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.982521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.982894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.996222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:11.998040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:12.020060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:12.021327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:12.023603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:12.023603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:12.023603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:12.023603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:12.023603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 603/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:12.030876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:12.146721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:12.149790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de043-0016-443c-9829-e1e5d6cf6cfe None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:12.189667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:12.190882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:12.191888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:12.191888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:12.192132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:12.192402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:12.194140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:12.214046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 608/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:12.222486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:12.347411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031a94-4e88-45d6-8df8-6f397cf64cd0 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:12.348970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:12.395518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:12.396707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:12.397296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:12.397763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:12.410591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:12.412525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:35:12.438692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:12.439909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:12.440853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 604/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:12.448356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:12.571543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944e8b-9b2e-4d7d-bd18-491847356b37 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:12.618137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:12.618994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:12.620047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:12.620047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:12.620721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:12.621150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:12.622723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:12.644451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 609/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 19 15:35:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:12.651474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:12.786182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0382-b4e1-4a9e-b74e-ac0566f4b0cd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:12.823149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:12.824065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:12.824185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:12.824437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:12.862980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:12.911216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:12.912632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:13.031523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 605/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:35:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:35:13.032929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:13.054131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:13.147100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e38201-8a55-413a-b409-4a32fa2297f1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:13.194157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:13.195032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:13.195327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:13.195709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:13.209573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:13.211776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:13.232458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:13.234879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:13.235845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:13.235845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:13.235845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:13.235845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:13.235845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 610/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:13.241116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:13.315124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:13.360816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994999-ac5d-41bf-800d-d2bde8a19c3a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:13.401252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:13.401920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:13.402207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:13.402783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:13.403513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:13.403823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:13.405199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:13.422111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 606/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:13.424227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:13.502446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:13.537613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7827371-d5b2-499c-9784-f2889b3899cc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:13.574627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:13.575498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:13.575773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:13.576063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:13.584354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:13.585794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:35:13.600349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:13.601398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:13.602292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 611/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:13.607726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:13.739438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8960dc-29b7-45ee-a648-93c9d33c091f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:13.769109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:13.784220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:13.785190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:13.785631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:13.786149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:13.787443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:13.787824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:13.789862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68cf3-f642-48eb-bbeb-4100e2b072cd None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:13.806934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 607/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:13.814207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:13.928181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aef95-c1fc-4513-a09a-42057bcdff92 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:13.963552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:13.970162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:13.970762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:13.971045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:13.971321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:13.972148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=f3a1ee469cae4cf8a166bc259d3e17c0) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:13.972462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:13.974627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93236-0500-4440-9444-d776a786cf88 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:13.980601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 612/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:35:13 2022] GET /identity/v3/role_assignments?user.id=f3a1ee469cae4cf8a166bc259d3e17c0&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:35:16.031723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3fb3-73dc-4914-b0ee-dbae7edeb58c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.032805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3fb3-73dc-4914-b0ee-dbae7edeb58c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.032904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3fb3-73dc-4914-b0ee-dbae7edeb58c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.034318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 608/1220] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:35:16.039909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.040515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.040639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.057729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:16.058959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:16.131450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 613/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:35:16.155536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3fb3-73dc-4914-b0ee-dbae7edeb58c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.261298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3fb3-73dc-4914-b0ee-dbae7edeb58c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.301130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.301913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.302200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.302546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.317338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:35:16.325977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:16.327258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:16.328454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 609/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:16.334660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.444193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13718d4-9bdb-4a81-b1f9-26fec717b926 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.468807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:16.482151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.482905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.483251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.483610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.484379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:16.484720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:16.487035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:16.496552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 614/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:16.503289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.552683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:16.612234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9ec6-afbf-4024-ab14-05ea80cb806f None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.652148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.653398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.653936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.654475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.666070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:16.668153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:16.689299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:16.690406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:16.696418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:16.696418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:16.696418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:16.696418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:16.696418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 610/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:16.697309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.807803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8288b60-9cc4-4c94-b8b9-7451c7295b8f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.849076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.849745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.850034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.850315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.851073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:16.851390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:16.852770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:16.864946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 615/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:35:16.874049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.978825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:16.988265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7b2d-42ed-40bb-822e-2c620726047d None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:17.026840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:17.027967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:17.028173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:17.028452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:17.036838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:17.038373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:35:17.054321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:17.055589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:17.056943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 611/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:17.061413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:17.116745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:17.177695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fc62b-2185-46eb-aa36-897acb529ac1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:17.215133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:17.215860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:17.216201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:17.216573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:17.217534 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:17.217892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:17.219485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.239061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 616/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 19 15:35:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:17.245031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:17.359888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492cad6-cc5d-49f9-97f1-946265663482 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:17.402463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:17.403608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:17.404022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:17.404307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:17.418075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:17.419604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:17.438707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:17.439824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:17.440861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:17.440861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:17.440861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:17.440861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:17.440861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 612/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:17.445862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:17.553796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cae20-a0e9-4796-8b6d-1624c782972f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:17.556203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:17.595715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:17.596433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:17.596783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:17.597108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:17.597888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:17.598215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:17.599958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.612116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 617/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:35:17.618085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:17.628029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:17.733949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7551-ed2b-4e65-aa63-4e65fd52d755 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:17.773070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:17.773873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:17.774156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:17.774482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:17.782454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:17.784074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:35:17.799621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:17.800781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:17.801814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 613/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:35:17.807137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:17.925157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e45f2-cf7e-4e12-a050-797938cb5496 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:17.963990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:17.964652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:17.964929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:17.965238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:17.966120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:17.966463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:17.967924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7269ce0-8835-4151-8ef1-b39c847924f4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.981451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 618/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:35:17.988474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:18.070705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:18.113666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214434-111a-4b94-bb16-381e2f8dbfea None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:18.154879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17dc9f-0d4d-4971-9dda-c492a31c0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:18.155775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17dc9f-0d4d-4971-9dda-c492a31c0952 None admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:18.156063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17dc9f-0d4d-4971-9dda-c492a31c0952 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:18.156455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17dc9f-0d4d-4971-9dda-c492a31c0952 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/f3a1ee469cae4cf8a166bc259d3e17c0/roles/8ae5cef923fc4453b0dda676f306f81c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:18.174050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17dc9f-0d4d-4971-9dda-c492a31c0952 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=f3a1ee469cae4cf8a166bc259d3e17c0, role_id=8ae5cef923fc4453b0dda676f306f81c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:18.176035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17dc9f-0d4d-4971-9dda-c492a31c0952 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:18.191209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 614/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:35:17 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/f3a1ee469cae4cf8a166bc259d3e17c0/roles/8ae5cef923fc4453b0dda676f306f81c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:20.287161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02b223-8d0c-4de9-9ac5-ff4539a5d443 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:20.287804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02b223-8d0c-4de9-9ac5-ff4539a5d443 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:20.287804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02b223-8d0c-4de9-9ac5-ff4539a5d443 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:20.289074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 619/1233] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:20.294413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:20.294898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:20.295024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:20.314024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:20.315509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:20.401076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 615/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:20.427675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02b223-8d0c-4de9-9ac5-ff4539a5d443 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:20.457160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:20.543549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02b223-8d0c-4de9-9ac5-ff4539a5d443 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:20.580743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:20.581543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:20.581830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:20.582110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:20.592279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:35:20.600876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:20.602009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:20.603108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 620/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 19 15:35:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:35:20.610437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:20.660031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:20.722752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a611f0-01ea-402f-845a-aeda0b0214a1 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:20.759134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:20.759812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:20.760102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:20.760387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:20.761143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] RBAC: Adding query filter params (name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:20.761473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:20.762991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:20.772898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 616/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 19 15:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:20.778684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:20.874464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:20.892463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e453b-cc7f-4c68-8ce6-cce4d4fc8db8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:20.931577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:20.932434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:20.932725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:20.933071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:20.948188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:20.949826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:20.974538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:20.975700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:20.981119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:20.981119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:20.981119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:20.981119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:20.981119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 621/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:20.982182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:21.091352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0adb-2549-4731-82b7-a17e8e7040de None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:21.100847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:21.128694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:21.129289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:21.129579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:21.129908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:21.130768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:21.131081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:21.132526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:21.146481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 617/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:21.152439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:21.264945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cf7b-a7d9-4dc8-8619-acc70dc4d2f3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:21.302722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:21.303722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:21.304017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:21.304370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:21.307730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:21.315553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:21.317271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:35:21.335445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:21.336878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:21.338449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 622/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:21.343343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:21.457806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb58d9-4bb4-4d07-91aa-86c4d722bcf3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:21.494439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:21.495183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:21.495575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:21.495945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:21.497007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:21.497502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:21.499189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:21.521127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 618/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 19 15:35:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:21.527933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:21.640501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde441c-fa4a-423d-9579-2ccc2e56f47f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:21.679335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:21.679996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:21.680286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:21.680568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:21.748615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:21.757031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:21.758662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:21.878287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 623/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:35:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:35:21.884894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:21.916238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:22.007807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cc1f5-2d49-47ad-92d5-d03beeef094a None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:22.046377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:22.047313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:22.048223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:22.048636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:22.060257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:22.061681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:22.079441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:22.081322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:22.082474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:22.082474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:22.082474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:22.082474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:22.082474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 619/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:35:22.086649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:22.186957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:22.193798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410030-74d6-4f3e-afcd-ccc4cdb9d742 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:22.227200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:22.227861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:22.228143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:22.228416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:22.229134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:22.229440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:22.230841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:22.242786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 624/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:22.248792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:22.345427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:22.377010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb829-e574-4a6f-b0e4-91d3fac8e4dd None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:22.418511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:22.419306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:22.419629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:22.419914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:22.427994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:22.429421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:35:22.443173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:22.444240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:22.450282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 620/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:35:22.450950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:22.568999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d747725-c7f0-4ae0-ae26-fc2a52eb494f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:22.606807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:22.607400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:22.607681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:22.607958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:22.608749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:22.609061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:22.611177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d3fa0-fe8c-49f9-bcda-a3ed8d8e67ec None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:22.624224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 625/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:22.630915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:22.746816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c9fb6-9ce6-4f2a-9a32-91fe1e56d0bc None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:22.785378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:22.786064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:22.786435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:22.786778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:22.787679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] RBAC: Adding query filter params (role.id=8ae5cef923fc4453b0dda676f306f81c, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=f3a1ee469cae4cf8a166bc259d3e17c0) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:22.788054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:22.789648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe057834-ae8b-4f4e-a5df-219b27255be3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:22.795989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 621/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:35:22 2022] GET /identity/v3/role_assignments?user.id=f3a1ee469cae4cf8a166bc259d3e17c0&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=8ae5cef923fc4453b0dda676f306f81c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:24.913133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4930-3367-4109-a6c4-9a3e6e3b0360 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:24.913755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4930-3367-4109-a6c4-9a3e6e3b0360 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:24.913755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4930-3367-4109-a6c4-9a3e6e3b0360 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:24.915251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 626/1247] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:24.920494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:24.921007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:24.921139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:24.926800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:24.940118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:24.941219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:25.017189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 622/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:25.039811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4930-3367-4109-a6c4-9a3e6e3b0360 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:25.061109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:25.161051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4930-3367-4109-a6c4-9a3e6e3b0360 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:25.202239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:25.203000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:25.203384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:25.203814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:25.215391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:35:25.224658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:25.225702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:25.226639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 627/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:25.232904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:25.353277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb185-acfc-4556-b0e0-8eeee786badf None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:25.388776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:25.394782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:25.395697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:25.396092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:25.396424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:25.397186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:25.397502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:25.399081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:25.413950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 623/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:25.415472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:25.506988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:25.535106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb62fd-d692-4db2-a6e7-c09a3bd4e7fa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:25.573678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:25.574590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:25.574892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:25.575368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:25.587093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:25.588683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:25.608291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:25.609368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:25.611109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:25.611109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:25.611109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:25.611109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:25.611109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 628/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:25.616613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:25.738837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7f9a-3c82-42ca-81d4-c4f42d567eca None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:25.776121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:25.776704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:25.776998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:25.777284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:25.778389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:25.778741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:25.780170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:25.793030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 624/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:25.799323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:25.914417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b409aad-ce8b-4350-a7eb-5c510182ea96 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:25.947173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:25.956844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:25.957651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:25.957936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:25.958214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:25.966657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:25.968095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:35:25.982609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:25.984348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:25.986340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 629/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:35:25.990723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:26.051136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:26.103495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf349f0-b5d9-40b5-8de6-0e851d1b3fc7 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:26.144283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:26.145012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:26.145368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:26.145649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:26.146737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:26.147085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:26.148787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:26.168675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 625/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:26.176150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:26.290781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38041070-8a94-4609-9980-18dfc5c006b0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:26.331112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:26.332026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:26.332518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:26.332976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:26.402437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:26.415965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:26.417427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:26.524473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 630/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:35:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:35:26.530931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:26.634819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97752-50e1-4e1a-a46d-ef53b084da24 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:26.652323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:26.677408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:26.678176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:26.678547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:26.678800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:26.690607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:26.692070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:26.711016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:26.712937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:26.715044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:26.715044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:26.715044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:26.715044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:26.715044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 626/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:26.718259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:26.821134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:26.833762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7721-dbd8-4791-a3f4-10a51cb9e427 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:26.872539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:26.873211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:26.873498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:26.873780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:26.874527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:26.874925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:26.876694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:26.888171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 631/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:26.894055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:27.025239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016a2a9-0b6c-426c-b595-1de844d07ae5 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:27.066072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:27.066900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:27.067191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:27.067474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:27.074278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:27.075898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:35:27.093012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:27.094913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:27.096229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 627/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:35:27.101050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:27.219934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8770-bf71-43c8-8948-783deff27ff8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:27.259517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:27.260295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:27.260654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:27.260990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:27.261930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:27.262304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:27.263955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06bff3-3bd3-4b22-8f10-03dee4c2c690 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:27.280666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 632/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:27.287793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:27.322330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:27.415337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b86c-52c6-4753-b1a3-67c7f13d2720 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:27.451781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:27.452464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:27.452743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:27.453022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:27.453917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=f3a1ee469cae4cf8a166bc259d3e17c0) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:27.454299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:27.455773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8847137-c367-49f2-bc85-c344794bb9d8 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:27.462083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 628/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:35:27 2022] GET /identity/v3/role_assignments?user.id=f3a1ee469cae4cf8a166bc259d3e17c0&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:29.500201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ea3e-047e-4682-be74-c10a9067bb9c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:29.501502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ea3e-047e-4682-be74-c10a9067bb9c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:29.501502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ea3e-047e-4682-be74-c10a9067bb9c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:29.502708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 633/1261] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:29.507942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:29.508357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:29.508500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:29.524791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:29.525959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:29.590428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 629/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:29.613156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ea3e-047e-4682-be74-c10a9067bb9c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:29.623897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:29.713868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ea3e-047e-4682-be74-c10a9067bb9c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:29.746893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:29.747665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:29.747949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:29.748225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:29.758920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:35:29.766407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:29.767573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:29.768611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 634/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:29.773802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:29.792937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:29.871995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6623f-8bd0-4c77-b1e3-002d0babb222 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:29.904081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:29.904733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:29.905015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:29.905290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:29.906025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:29.906330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:29.908255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:29.915972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 630/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:29.921710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:29.987623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.019981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831c62-9836-416e-a10d-2bc797d994c2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:30.054740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:30.055517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.055805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.056086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.066291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:30.067750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:30.084173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:30.085243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:30.086550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:30.086550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:30.086550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:30.086550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:30.086550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 635/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:30.091232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.169531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.188599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d10f3-0026-4184-95c9-afcc44baf095 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:30.221607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:30.222255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.222574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.222856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.223579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:30.223889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:30.225246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:30.236936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 631/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:30.242597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.347904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c84dd-92e7-4e03-9c92-31bcfaa379f0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:30.369996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.385537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:30.386333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.386726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.387000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.394874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:30.396302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:35:30.410973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:30.412190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:30.413198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 636/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:30.418036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.515317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16568532-cfee-4d7d-a660-9b9ff24e9f40 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:30.549212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:30.549876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.550162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.550483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.551310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:30.551624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:30.553057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:30.561439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.570591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 632/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:30.576223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.674188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9cf7a-67c1-49c0-8b36-8a95aa1974e8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:30.708261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:30.709047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.709334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.709612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.720238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:30.721675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:30.738252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:30.739344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:30.740246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:30.740246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:30.740246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:30.740246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:30.740246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 637/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:30.745213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.844925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb479d3d-c7ae-4b64-830c-0efbc6c66a3e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:30.877432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:30.878085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.878392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.878674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.879390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:30.879696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:30.881052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:30.892711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 633/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:30.898611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.931075 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.997608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471064e-8404-42d3-bf07-d4786b25c913 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:31.030067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:31.030878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:31.031164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:31.031443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:31.038569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:31.040018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:35:31.055981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:31.057031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:31.058081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 638/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:31.063198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:31.121546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:31.162607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58198ac-650f-4ad6-9179-600710c82e88 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:31.194455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:31.195045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:31.195326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:31.195601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:31.196381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:31.196690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:31.198115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8575ec-1521-4019-94ef-46f81e79b7b7 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:31.210149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 634/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:31.216233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:31.308503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:31.318345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936bb6-9ff8-4eae-9931-02051cf924df None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:31.354232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366979-2d1b-4547-a44d-2918e1a84d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:31.355138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366979-2d1b-4547-a44d-2918e1a84d95 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:31.355422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366979-2d1b-4547-a44d-2918e1a84d95 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:31.355697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366979-2d1b-4547-a44d-2918e1a84d95 None admin] PATH_INFO: `/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/f3a1ee469cae4cf8a166bc259d3e17c0/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:31.357602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366979-2d1b-4547-a44d-2918e1a84d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user_id=f3a1ee469cae4cf8a166bc259d3e17c0, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:31.359088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366979-2d1b-4547-a44d-2918e1a84d95 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:31.371232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 639/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 19 15:35:31 2022] PUT /identity/v3/projects/ddde0c699c9f4c57a812bfb3b2bfa3a2/users/f3a1ee469cae4cf8a166bc259d3e17c0/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:33.389200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ec5e-5a33-4853-a9a2-f2a25390cbdb None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:33.389731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ec5e-5a33-4853-a9a2-f2a25390cbdb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:33.389856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ec5e-5a33-4853-a9a2-f2a25390cbdb None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:33.391321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 635/1274] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:33.397379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d043d3-8554-494d-912a-184a1deb936e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:33.397823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d043d3-8554-494d-912a-184a1deb936e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:33.397950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d043d3-8554-494d-912a-184a1deb936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:33.418286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-02d043d3-8554-494d-912a-184a1deb936e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:33.419513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-02d043d3-8554-494d-912a-184a1deb936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:33.488324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 640/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:33.512185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ec5e-5a33-4853-a9a2-f2a25390cbdb None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:33.612390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ec5e-5a33-4853-a9a2-f2a25390cbdb None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:33.629123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:33.645819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:33.646572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:33.646860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:33.647140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:33.658027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:35:33.665588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:33.666704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:33.667665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 636/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 19 15:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:33.673442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d043d3-8554-494d-912a-184a1deb936e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:33.753379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:33.772238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d043d3-8554-494d-912a-184a1deb936e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:33.806348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:33.807047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:33.807334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:33.807615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:33.808362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:33.808672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:33.810031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:33.817883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 641/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 19 15:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:33.823660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:33.921757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d610e-ba66-4d71-8752-1a82e6809b3b None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:33.954910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:33.955684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:33.955972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:33.956247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:33.966426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:33.967877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:33.985189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:33.986216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:33.987221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:33.987221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:33.987221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:33.987221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:33.987221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 637/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:33.992158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:34.091733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df191c45-05a4-4b94-9df5-e1cdbfbc35d0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:34.127430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:34.128087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:34.128371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:34.128651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:34.129374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:34.129687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:34.131077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:34.143020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 642/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:34.148664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:34.179903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:34.247409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66dcb-a7a7-4459-b6d2-695236c58b88 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:34.280041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:34.280821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:34.281113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:34.281393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:34.290655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:34.292357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:35:34.310380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:34.311407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:34.312349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 638/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:34.318958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:34.323472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:34.420972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c722b14-39ab-4754-bb09-ddc96f161da7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:34.453747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:34.454348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:34.454663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:34.454945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:34.455783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:34.456096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:34.457519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:34.475161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 643/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 19 15:35:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:34.480857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:34.569714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:34.579403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c30609-8525-400f-b742-aa38b733d9ec None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:34.612175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:34.612808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:34.613093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:34.613374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:34.678037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:34.679530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:34.764953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:34.775914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 639/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 19 15:35:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:35:34.782072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:34.842248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:34.880929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765c307-451d-4608-b548-cba2e0e2f34c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:34.913592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:34.914403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:34.914693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:34.914977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:34.925438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:34.926917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:35:34.944577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:34.945625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:34.946746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:35:34.946746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:35:34.946746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:35:34.946746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:34.946746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 644/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:34.951408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:35.046266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b42bc6-b4ec-49fe-ae8f-0e19183f1ae3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:35.079183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:35.079827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:35.080109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:35.080386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:35.081092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:35.081397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:35.082789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:35.094835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 640/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 19 15:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:35.100406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:35.197833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347866e8-83a7-443e-ab58-e179be5a1607 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:35.211525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:35.232283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:35.233065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:35.233350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:35.233624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:35.240741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:35.242163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:35:35.255875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:35.256931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 19 15:35:35.262826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 645/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 19 15:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:35.263448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:35.312745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:35.362298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d827f-3991-4f10-ae02-196bb8bf0fe6 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:35.393909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:35.394592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:35.394881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:35.395162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:35.395958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:35.396268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:35.397692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780ba74-866f-45b9-8168-9010194be740 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:35.415656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 641/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 19 15:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:35.423060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:35.527572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545bb8-00b7-49d8-96ef-f470300dc2cd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:35.561322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:35.561970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:35.562254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:35.562565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:35.563489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] RBAC: Adding query filter params (role.id=d30b9543b0b7460283d44cf48ff820e9, scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2, user.id=f3a1ee469cae4cf8a166bc259d3e17c0) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:35.563754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:35.565617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3b3ae-5240-4385-bb01-328d0e27b752 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:35.572357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 646/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 19 15:35:35 2022] GET /identity/v3/role_assignments?user.id=f3a1ee469cae4cf8a166bc259d3e17c0&scope.project.id=ddde0c699c9f4c57a812bfb3b2bfa3a2&role.id=d30b9543b0b7460283d44cf48ff820e9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:37.693079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50936c41-d70b-4def-b40e-e405c7e167cf None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:37.693519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50936c41-d70b-4def-b40e-e405c7e167cf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:37.693650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50936c41-d70b-4def-b40e-e405c7e167cf None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:37.695072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 642/1288] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:37.700223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:37.700625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:37.700778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:37.717524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:37.718736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:37.747081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:37.783723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 647/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:37.805504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50936c41-d70b-4def-b40e-e405c7e167cf None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:37.904791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50936c41-d70b-4def-b40e-e405c7e167cf None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:37.916315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:37.939129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:37.939850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:37.940136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:37.940418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:37.941066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:37.942469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:37.954508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:37.955759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:37.956819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 643/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:35:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:37.961793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:38.058419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396eece-d757-4a3b-b67c-ad8c05a2e315 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:38.092132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:38.092790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:38.093079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:38.093361 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:38.094090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:38.094430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:38.095915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa281dd-0ebd-41ac-89f9-db893da6bf13 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:38.100835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 648/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 19 15:35:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:38.106641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:38.205266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fcce8-edc2-4bdf-907a-08561e62a20e None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:38.236667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:38.237313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:38.237596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:38.237870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] PATH_INFO: `/v3/services` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:38.238595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] RBAC: Adding query filter params (type=placement) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:38.238903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:38.240340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c88ae-165e-403c-b2f1-61fdf951af2e None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:38.244624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 644/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 19 15:35:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:40.269349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5472840-1f0f-4c16-a2c9-0d921ab46686 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:40.269877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5472840-1f0f-4c16-a2c9-0d921ab46686 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:40.269972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5472840-1f0f-4c16-a2c9-0d921ab46686 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:40.271322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 649/1293] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:40.276484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41137dd8-67ca-4b2f-9b9b-feb30cf06697 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:40.276913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41137dd8-67ca-4b2f-9b9b-feb30cf06697 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:40.277056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41137dd8-67ca-4b2f-9b9b-feb30cf06697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:40.295200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-41137dd8-67ca-4b2f-9b9b-feb30cf06697 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:40.296578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-41137dd8-67ca-4b2f-9b9b-feb30cf06697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:40.332537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:40.379659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 645/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:40.402829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5472840-1f0f-4c16-a2c9-0d921ab46686 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:40.433339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:40.507063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5472840-1f0f-4c16-a2c9-0d921ab46686 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:40.540389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cce7a-ad94-4388-b1a9-398e258c7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:40.540983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cce7a-ad94-4388-b1a9-398e258c7da2 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:40.541270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cce7a-ad94-4388-b1a9-398e258c7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:40.541551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cce7a-ad94-4388-b1a9-398e258c7da2 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:40.542266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cce7a-ad94-4388-b1a9-398e258c7da2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:40.543662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cce7a-ad94-4388-b1a9-398e258c7da2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:40.557035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 650/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 19 15:35:40 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:42.616074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1633-52a0-404c-bfc8-ae6818a7f534 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:42.616630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1633-52a0-404c-bfc8-ae6818a7f534 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:42.616630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1633-52a0-404c-bfc8-ae6818a7f534 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:42.618014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 646/1296] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:42.623199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:42.623570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:42.623761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:42.640612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:42.642639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:42.713965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 651/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:42.737029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1633-52a0-404c-bfc8-ae6818a7f534 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:42.836274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1633-52a0-404c-bfc8-ae6818a7f534 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:42.868473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:42.869414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:42.869518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:42.869772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:42.870562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:42.871938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:42.884294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:42.885431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:42.886491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 647/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:35:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:42.892281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:42.910168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:42.989166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f145a02-3a92-45b9-a024-ea6b3e1ec4d1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:43.021954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:43.022639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:43.022930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:43.023213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:43.023919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] RBAC: Adding query filter params (name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:43.024231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:43.025609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:43.030902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 652/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 19 15:35:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:43.037334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:43.069416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:43.136267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe11cde-d6b8-4a10-8296-bf6f8cfd40f9 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:43.169783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:43.170464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:43.170756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:43.171037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:43.171823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] RBAC: Adding query filter params (interface=public, service_id=3db664d4aaad42f88c1d7197b9b1377c, region_id=RegionOne) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:43.172684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:43.174174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ed2fb-9c30-400e-a18d-9ba8b3364d62 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:43.179239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 648/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 19 15:35:43 2022] GET /identity/v3/endpoints?service_id=3db664d4aaad42f88c1d7197b9b1377c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:43.184773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:43.264345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:43.283521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0207e-6263-4d94-8e0a-c195b10adceb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:43.318064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61919-0d41-4e94-b032-ccc4f636d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:43.318755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61919-0d41-4e94-b032-ccc4f636d131 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:43.319046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61919-0d41-4e94-b032-ccc4f636d131 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:43.319333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61919-0d41-4e94-b032-ccc4f636d131 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:43.320018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61919-0d41-4e94-b032-ccc4f636d131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:43.321386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61919-0d41-4e94-b032-ccc4f636d131 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:43.328072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 653/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 19 15:35:43 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:35:45.364870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac312f2-608c-44f9-9a9d-222b788e9a14 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.365432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac312f2-608c-44f9-9a9d-222b788e9a14 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.365432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac312f2-608c-44f9-9a9d-222b788e9a14 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.366821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 649/1302] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:35:45.372031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.372443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.372585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.388713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:45.389884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:45.454258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 654/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:35:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:35:45.477053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac312f2-608c-44f9-9a9d-222b788e9a14 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:45.571059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:45.578015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac312f2-608c-44f9-9a9d-222b788e9a14 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:45.610954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:45.611751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.612042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.612321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.612976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:45.614351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:35:45.626763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:35:45.627920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application with Lock( Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: ERROR keystone.server.flask.application Jul 19 15:35:45.628792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 650/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 19 15:35:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:35:45.633994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:45.709203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:45.731723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f907-dd77-42f4-b4d2-6c004c8bc415 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:45.765103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:45.765767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.766620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.766908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.767615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:45.767927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:45.769298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b750f-c1e2-4e1a-ad58-3f4fe4356999 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:45.774345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 655/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 19 15:35:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:45.780325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:45.878612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac638-7666-4ed8-96a8-3bc6a16085f3 None admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:45.911176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c1cb-5330-49db-9788-859eb81b7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:45.911826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c1cb-5330-49db-9788-859eb81b7b00 None admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.912117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c1cb-5330-49db-9788-859eb81b7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.912403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c1cb-5330-49db-9788-859eb81b7b00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.913153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c1cb-5330-49db-9788-859eb81b7b00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:45.914553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c1cb-5330-49db-9788-859eb81b7b00 None admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:45.932538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 651/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 19 15:35:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:55.771338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=30 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:55.928298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:49.377386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86d153-c0e7-4950-bcee-1a6e6339d829 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:49.377883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86d153-c0e7-4950-bcee-1a6e6339d829 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:49.377968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86d153-c0e7-4950-bcee-1a6e6339d829 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:49.383602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 656/1307] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:36:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:36:49.385291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2a35-7fa3-4f16-bffb-12faacf549ed None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:49.386166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2a35-7fa3-4f16-bffb-12faacf549ed None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:49.386728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2a35-7fa3-4f16-bffb-12faacf549ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:49.557533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-79da2a35-7fa3-4f16-bffb-12faacf549ed None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:49.558808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-79da2a35-7fa3-4f16-bffb-12faacf549ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:49.706384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 652/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:36:49.746906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33909ebc-fc1a-4e4e-be51-0a02b1bf4176 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:49.747641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33909ebc-fc1a-4e4e-be51-0a02b1bf4176 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:49.748153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33909ebc-fc1a-4e4e-be51-0a02b1bf4176 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:49.750465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 657/1309] 10.222.0.64 () {54 vars in 965 bytes} [Tue Jul 19 15:36:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:36:49.759887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d3a5-e2fb-4b52-b24c-7e4ca9cea4d4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:49.760193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d3a5-e2fb-4b52-b24c-7e4ca9cea4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:49.760469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d3a5-e2fb-4b52-b24c-7e4ca9cea4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:49.850700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9c98d3a5-e2fb-4b52-b24c-7e4ca9cea4d4 None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:49.851955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9c98d3a5-e2fb-4b52-b24c-7e4ca9cea4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:49.878559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:49.942646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 653/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Tue Jul 19 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:49.951824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33909ebc-fc1a-4e4e-be51-0a02b1bf4176 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:49.954265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-33909ebc-fc1a-4e4e-be51-0a02b1bf4176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:50.080694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33909ebc-fc1a-4e4e-be51-0a02b1bf4176 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:50.165729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:50.166409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:50.166704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:50.166987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:50.168654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:50.234893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:50.295699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:50.297618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72a81e-3a47-43c9-bb11-e1eb24c9a216 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:50.318665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 658/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:52.751129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36154e-5b5c-4085-b30f-8f2ebeecb6b5 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:52.751686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36154e-5b5c-4085-b30f-8f2ebeecb6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:52.751686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36154e-5b5c-4085-b30f-8f2ebeecb6b5 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:52.753134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 654/1312] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:36:52.758455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2e703-976a-4872-a40e-c605f4ec24fe None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:52.758839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2e703-976a-4872-a40e-c605f4ec24fe None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:52.759086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2e703-976a-4872-a40e-c605f4ec24fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:52.834412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cce2e703-976a-4872-a40e-c605f4ec24fe None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:52.835892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cce2e703-976a-4872-a40e-c605f4ec24fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:52.936294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 659/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:52.975234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36154e-5b5c-4085-b30f-8f2ebeecb6b5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:52.976871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1c36154e-5b5c-4085-b30f-8f2ebeecb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:53.091802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36154e-5b5c-4085-b30f-8f2ebeecb6b5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:53.173424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:53.176365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:53.177422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:53.178019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:53.178734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:53.180503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:53.293078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:53.294591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47915c7b-dca0-4418-b48a-3db96a82c23f service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:53.317460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 655/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:55.654748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab55ebe-d205-4f2a-a8db-e53b1b7803ee None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:55.655298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab55ebe-d205-4f2a-a8db-e53b1b7803ee None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:55.655298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab55ebe-d205-4f2a-a8db-e53b1b7803ee None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:55.657342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 660/1315] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:36:55.662500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d939d-5d1e-45c8-81c1-9628b8319608 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:55.662940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d939d-5d1e-45c8-81c1-9628b8319608 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:55.663047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d939d-5d1e-45c8-81c1-9628b8319608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:55.727135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e39d939d-5d1e-45c8-81c1-9628b8319608 None None] MFA Rules not processed for user `73aed356c605492792678ec83716339a`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:55.728270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e39d939d-5d1e-45c8-81c1-9628b8319608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:55.779166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:55.824813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 656/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:36:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:36:55.879687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff9d16-c195-48d2-bf4f-33417c36315b None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:55.880230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff9d16-c195-48d2-bf4f-33417c36315b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:55.880734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff9d16-c195-48d2-bf4f-33417c36315b None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:55.882666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 661/1317] 10.222.0.64 () {54 vars in 965 bytes} [Tue Jul 19 15:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:36:55.888634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90d7b-4895-4d01-b9ab-37ae67e32d72 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:55.888929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90d7b-4895-4d01-b9ab-37ae67e32d72 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:55.889520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90d7b-4895-4d01-b9ab-37ae67e32d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:55.964597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-dbb90d7b-4895-4d01-b9ab-37ae67e32d72 None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:55.965830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dbb90d7b-4895-4d01-b9ab-37ae67e32d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:56.040048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 657/1318] 10.222.0.64 () {58 vars in 1062 bytes} [Tue Jul 19 15:36:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:56.049347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff9d16-c195-48d2-bf4f-33417c36315b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:56.051035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bcff9d16-c195-48d2-bf4f-33417c36315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:56.060587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:56.155166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff9d16-c195-48d2-bf4f-33417c36315b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:56.226712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:56.227352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:56.227638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:56.227915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:56.229556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:56.291290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:56.338370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:56.339825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fc6a7-f388-4665-9304-1d378fdab097 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:56.358349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 662/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:59.474630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1e93-2522-481e-921e-af437f2acde1 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:59.475096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1e93-2522-481e-921e-af437f2acde1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:59.475210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1e93-2522-481e-921e-af437f2acde1 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:59.476580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 658/1320] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:36:59.481876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff6ed-060c-422c-8202-756779653ba1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:59.482262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff6ed-060c-422c-8202-756779653ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:59.482460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff6ed-060c-422c-8202-756779653ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:59.545867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-493ff6ed-060c-422c-8202-756779653ba1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:59.547246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-493ff6ed-060c-422c-8202-756779653ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:59.643709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 663/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:59.683423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1e93-2522-481e-921e-af437f2acde1 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:59.684961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-274d1e93-2522-481e-921e-af437f2acde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:59.734920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:59.789189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1e93-2522-481e-921e-af437f2acde1 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:59.861365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:59.862010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:59.862295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:59.862604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:59.864249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:59.964247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:59.977962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:59.979463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cf03d-1072-4282-a53a-28460b975ff5 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:59.997918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 659/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:02.805987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189ff0-e14a-4d84-9165-27e64d55176e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:02.806630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189ff0-e14a-4d84-9165-27e64d55176e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:02.806630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189ff0-e14a-4d84-9165-27e64d55176e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:02.808028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 664/1323] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:02.813562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343eb26-a503-4477-8e14-e304f89bc2f3 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:02.814020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343eb26-a503-4477-8e14-e304f89bc2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:02.814170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343eb26-a503-4477-8e14-e304f89bc2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:02.880401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2343eb26-a503-4477-8e14-e304f89bc2f3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:02.881616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2343eb26-a503-4477-8e14-e304f89bc2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:02.986597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 660/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:37:03.024070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1189ff0-e14a-4d84-9165-27e64d55176e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:03.025653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c1189ff0-e14a-4d84-9165-27e64d55176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:03.046209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:03.137780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1189ff0-e14a-4d84-9165-27e64d55176e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:03.212773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:03.213424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:03.213707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:03.213984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:03.215792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:03.286570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:03.326318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:03.327795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b0f94-d3e7-463d-bf96-2587968d9be0 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:03.346704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 665/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:05.476856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378c77-23e3-41f0-b07c-19e6dad22e3c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:05.477358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378c77-23e3-41f0-b07c-19e6dad22e3c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:05.477358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378c77-23e3-41f0-b07c-19e6dad22e3c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:05.478877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 661/1326] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:05.484587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e2e1-23fc-4314-bd56-663455f74685 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:05.485012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e2e1-23fc-4314-bd56-663455f74685 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:05.485295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e2e1-23fc-4314-bd56-663455f74685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:05.552236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-df94e2e1-23fc-4314-bd56-663455f74685 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:05.556817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-df94e2e1-23fc-4314-bd56-663455f74685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:05.655533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 666/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:37:05.692034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef378c77-23e3-41f0-b07c-19e6dad22e3c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:05.693559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ef378c77-23e3-41f0-b07c-19e6dad22e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:05.753991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:05.798699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef378c77-23e3-41f0-b07c-19e6dad22e3c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:05.873429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:05.874081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:05.874457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:05.874674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:05.876540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:05.989031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:05.991582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:05.993149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa78d0-9192-4619-b683-dcc1b92993d2 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:06.012451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 662/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:08.111250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11720-4d55-4a19-b436-afc4b7dfadd1 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:08.111806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11720-4d55-4a19-b436-afc4b7dfadd1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:08.111806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11720-4d55-4a19-b436-afc4b7dfadd1 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:08.113182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 667/1329] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:08.118555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6328f-e804-4516-ab38-38da252a1c1a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:08.118995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6328f-e804-4516-ab38-38da252a1c1a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:08.119119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6328f-e804-4516-ab38-38da252a1c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:08.182732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-1da6328f-e804-4516-ab38-38da252a1c1a None None] MFA Rules not processed for user `73aed356c605492792678ec83716339a`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:08.183944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1da6328f-e804-4516-ab38-38da252a1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:08.283688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 663/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:08.321788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11720-4d55-4a19-b436-afc4b7dfadd1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:08.323432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7cf11720-4d55-4a19-b436-afc4b7dfadd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:08.358115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:08.434374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11720-4d55-4a19-b436-afc4b7dfadd1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:08.509868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:08.510555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:08.510842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:08.511131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:08.512843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:08.601998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:08.633639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:08.635099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253435-5c97-495a-ad1f-889ff95fa91b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:08.653089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 668/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:11.011322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cc98b-655d-4247-a557-4d051c367d0e None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:11.011831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cc98b-655d-4247-a557-4d051c367d0e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:11.011831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cc98b-655d-4247-a557-4d051c367d0e None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:11.013190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 664/1332] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:11.018944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91050a0b-66f4-4bb8-8e5d-d4aca20bc073 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:11.019333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91050a0b-66f4-4bb8-8e5d-d4aca20bc073 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:11.019495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91050a0b-66f4-4bb8-8e5d-d4aca20bc073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:11.082503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-91050a0b-66f4-4bb8-8e5d-d4aca20bc073 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:11.083701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-91050a0b-66f4-4bb8-8e5d-d4aca20bc073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:11.183468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 669/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:11.219508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cc98b-655d-4247-a557-4d051c367d0e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:11.221093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-015cc98b-655d-4247-a557-4d051c367d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:11.289916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:11.324277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cc98b-655d-4247-a557-4d051c367d0e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:11.395874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:11.396517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:11.396803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:11.397082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:11.398755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:11.507858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:11.509362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc23f-342e-4f2f-a2d6-8dcae92a59a3 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:11.519666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:11.528945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 665/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:13.628984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606fc94-0555-47bf-b13f-3ab1cb5cf7cf None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:13.629543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606fc94-0555-47bf-b13f-3ab1cb5cf7cf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:13.629543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606fc94-0555-47bf-b13f-3ab1cb5cf7cf None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:13.630958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 670/1335] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:13.636051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4595-f67c-4c65-b935-e41c43483cab None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:13.636431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4595-f67c-4c65-b935-e41c43483cab None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:13.636614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4595-f67c-4c65-b935-e41c43483cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:13.702777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f1fb4595-f67c-4c65-b935-e41c43483cab None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:13.704056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f1fb4595-f67c-4c65-b935-e41c43483cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:13.800805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 666/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:13.840998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606fc94-0555-47bf-b13f-3ab1cb5cf7cf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:13.842571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b606fc94-0555-47bf-b13f-3ab1cb5cf7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:13.883195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:13.951731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606fc94-0555-47bf-b13f-3ab1cb5cf7cf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:14.027554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:14.028208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:14.028503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:14.028790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:14.031384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:14.113910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:14.139123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:14.141089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c24bd7-537e-445a-bf9d-9beaf813b5bc service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:14.159600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 671/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:16.572230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f78b-1020-4e07-8d3a-85b8ba6ee130 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:16.572741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f78b-1020-4e07-8d3a-85b8ba6ee130 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:16.572741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f78b-1020-4e07-8d3a-85b8ba6ee130 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:16.574130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 667/1338] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:16.579896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351778-e7ca-4926-a837-72c3b056c563 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:16.580299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351778-e7ca-4926-a837-72c3b056c563 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:16.580461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351778-e7ca-4926-a837-72c3b056c563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:16.643808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4a351778-e7ca-4926-a837-72c3b056c563 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:16.645014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4a351778-e7ca-4926-a837-72c3b056c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:16.740481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 672/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:16.777056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4f78b-1020-4e07-8d3a-85b8ba6ee130 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:16.778666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fad4f78b-1020-4e07-8d3a-85b8ba6ee130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:16.854463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:16.882847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4f78b-1020-4e07-8d3a-85b8ba6ee130 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:16.959709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:16.960362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:16.960649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:16.960933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:16.962624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:17.070549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:17.071997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e308a30-67a8-4211-98ef-b98d180b8fa9 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:17.090697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 668/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:21.045085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f4a64-317a-4e51-b950-d0bc2790d6e2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:21.045652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f4a64-317a-4e51-b950-d0bc2790d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:21.045652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f4a64-317a-4e51-b950-d0bc2790d6e2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:21.047766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 673/1341] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:21.052695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc411-0fe3-4600-9075-7fa369355942 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:21.053093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc411-0fe3-4600-9075-7fa369355942 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:21.053250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc411-0fe3-4600-9075-7fa369355942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:21.057500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:21.119234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ab8dc411-0fe3-4600-9075-7fa369355942 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:21.120429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ab8dc411-0fe3-4600-9075-7fa369355942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:21.215596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 669/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:21.255779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f4a64-317a-4e51-b950-d0bc2790d6e2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:21.257362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0f1f4a64-317a-4e51-b950-d0bc2790d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:21.316789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:21.382186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f4a64-317a-4e51-b950-d0bc2790d6e2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:21.472868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:21.473534 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:21.473829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:21.474107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:21.475803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:21.571636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:21.588872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:21.590307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cbc4c-8c0b-4a4d-9fb5-4fbea0eff89e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:21.610518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 674/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:24.238380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec1c8-e383-42dd-b457-d8db56dfb8fa None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:24.238919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec1c8-e383-42dd-b457-d8db56dfb8fa None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:24.239047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec1c8-e383-42dd-b457-d8db56dfb8fa None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:24.240332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 670/1344] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:24.245478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382bbf-e630-4cf5-b285-98f70e86e6b3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:24.245886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382bbf-e630-4cf5-b285-98f70e86e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:24.246035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382bbf-e630-4cf5-b285-98f70e86e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:24.318893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-17382bbf-e630-4cf5-b285-98f70e86e6b3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:24.320153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-17382bbf-e630-4cf5-b285-98f70e86e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:24.423677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 675/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:24.462074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec1c8-e383-42dd-b457-d8db56dfb8fa None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:24.463654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8cbec1c8-e383-42dd-b457-d8db56dfb8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:24.553007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:24.570126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec1c8-e383-42dd-b457-d8db56dfb8fa None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:24.643088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:24.643740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:24.644029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:24.644314 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:24.645963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:24.761164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:24.762666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc5f8-4b8c-4e72-995d-b4281241aa4c service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:24.782839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 671/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:28.935881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b74608-9eed-45c0-86e6-7b42e6a00c4a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:28.936492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b74608-9eed-45c0-86e6-7b42e6a00c4a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:28.936828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b74608-9eed-45c0-86e6-7b42e6a00c4a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:28.938337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 676/1347] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:28.943788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554487b-6d54-47c7-bb95-711efd6546ff None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:28.944206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554487b-6d54-47c7-bb95-711efd6546ff None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:28.944486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554487b-6d54-47c7-bb95-711efd6546ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:28.958827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:29.013042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2554487b-6d54-47c7-bb95-711efd6546ff None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:29.014278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2554487b-6d54-47c7-bb95-711efd6546ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:29.114077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 672/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:29.156913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b74608-9eed-45c0-86e6-7b42e6a00c4a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:29.158508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a4b74608-9eed-45c0-86e6-7b42e6a00c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:29.223237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:29.272426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b74608-9eed-45c0-86e6-7b42e6a00c4a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:29.351151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:29.351810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:29.352093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:29.352367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:29.354044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:29.465739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:29.471493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:29.473355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6dc36-c124-4898-a7c9-d21723127207 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:29.495554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 677/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:37:34.458424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b70db-3c7c-43a4-b659-744690990123 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:34.458424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b70db-3c7c-43a4-b659-744690990123 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:34.458424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b70db-3c7c-43a4-b659-744690990123 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:34.458424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 673/1350] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:37:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:34.461882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3c48-d042-4852-ae52-8f7ccf4159b9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:34.462275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3c48-d042-4852-ae52-8f7ccf4159b9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:34.462772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3c48-d042-4852-ae52-8f7ccf4159b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:34.617820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8bfc3c48-d042-4852-ae52-8f7ccf4159b9 None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:34.619169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8bfc3c48-d042-4852-ae52-8f7ccf4159b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:34.745741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 678/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:39.111951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=59 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:39.207501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ba99-4b91-43d3-9aba-0c293ae20f6c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:39.207878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ba99-4b91-43d3-9aba-0c293ae20f6c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:39.208079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ba99-4b91-43d3-9aba-0c293ae20f6c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:39.209636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 674/1352] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:39.214524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cacde-f71b-4985-baf4-45d5e99321fb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:39.215010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cacde-f71b-4985-baf4-45d5e99321fb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:39.215102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cacde-f71b-4985-baf4-45d5e99321fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:39.271597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:39.299037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-392cacde-f71b-4985-baf4-45d5e99321fb None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:39.300461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-392cacde-f71b-4985-baf4-45d5e99321fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:39.428682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 679/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:40.679482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b533fb-5319-4b5f-917d-6d74892e4b04 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:40.680006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b533fb-5319-4b5f-917d-6d74892e4b04 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:40.680180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b533fb-5319-4b5f-917d-6d74892e4b04 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:40.681762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 675/1354] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:40.687482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb7d8-c48e-4bf6-bb42-8760edd057d1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:40.687922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb7d8-c48e-4bf6-bb42-8760edd057d1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:40.688046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb7d8-c48e-4bf6-bb42-8760edd057d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:40.763841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-75fcb7d8-c48e-4bf6-bb42-8760edd057d1 None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:40.765642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-75fcb7d8-c48e-4bf6-bb42-8760edd057d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:40.807133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:40.879511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 680/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:44.240150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0f30d-cb9a-4aa7-9fd7-bf430ed73e38 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:44.241115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0f30d-cb9a-4aa7-9fd7-bf430ed73e38 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:44.241570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0f30d-cb9a-4aa7-9fd7-bf430ed73e38 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:44.247199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 676/1356] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:44.250257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f593c-97ae-43d0-b421-ada158334ce5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:44.251488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f593c-97ae-43d0-b421-ada158334ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:44.251779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f593c-97ae-43d0-b421-ada158334ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:44.323727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-863f593c-97ae-43d0-b421-ada158334ce5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:44.324855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-863f593c-97ae-43d0-b421-ada158334ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:44.427255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 681/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:44.485929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff106a3-09f2-4cba-8681-79b381380737 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:44.486333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff106a3-09f2-4cba-8681-79b381380737 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:44.486833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff106a3-09f2-4cba-8681-79b381380737 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:44.488461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 677/1358] 10.222.0.64 () {54 vars in 962 bytes} [Tue Jul 19 15:37:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:44.496734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017eae-2fcd-41c5-a412-d221343fef74 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:44.497190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017eae-2fcd-41c5-a412-d221343fef74 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:44.497363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017eae-2fcd-41c5-a412-d221343fef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:44.522056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:44.588767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-31017eae-2fcd-41c5-a412-d221343fef74 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:44.589974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-31017eae-2fcd-41c5-a412-d221343fef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:44.724213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 682/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Tue Jul 19 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:44.731901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff106a3-09f2-4cba-8681-79b381380737 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:44.734226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cff106a3-09f2-4cba-8681-79b381380737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:44.895417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff106a3-09f2-4cba-8681-79b381380737 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:44.985699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:45.029470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:45.030460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:45.030763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:45.031050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:45.032730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:45.131343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:45.133600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170ab67-c025-4508-8185-43abdb6974bf service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:45.157142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 678/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:47.467880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb74076-ea74-425d-bfca-e1cc80eddf52 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:47.468493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb74076-ea74-425d-bfca-e1cc80eddf52 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:47.468493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb74076-ea74-425d-bfca-e1cc80eddf52 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:47.469943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 683/1361] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:47.475182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8441779-5711-47b4-b430-43117bec959e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:47.475612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8441779-5711-47b4-b430-43117bec959e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:47.475751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8441779-5711-47b4-b430-43117bec959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:47.544390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b8441779-5711-47b4-b430-43117bec959e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:47.545733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b8441779-5711-47b4-b430-43117bec959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:47.586893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:47.659078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 679/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:47.706339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb74076-ea74-425d-bfca-e1cc80eddf52 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:47.707929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3eb74076-ea74-425d-bfca-e1cc80eddf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:47.778990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:47.885279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb74076-ea74-425d-bfca-e1cc80eddf52 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:48.017369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:48.018078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:48.018452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:48.018710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:48.020512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:48.048109 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:48.120317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:48.122064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ffa1a-a4b9-4caf-aee2-18cfcac5d54e service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:48.141679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 684/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:50.570032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de84cc8-1a09-4a89-9d4e-d33e19e62585 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:50.570678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de84cc8-1a09-4a89-9d4e-d33e19e62585 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:50.570678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de84cc8-1a09-4a89-9d4e-d33e19e62585 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:50.572029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 680/1364] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:50.578205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e4d45-8975-4188-a523-521cc72957d4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:50.579117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e4d45-8975-4188-a523-521cc72957d4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:50.579553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e4d45-8975-4188-a523-521cc72957d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:50.647969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-796e4d45-8975-4188-a523-521cc72957d4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:50.649189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-796e4d45-8975-4188-a523-521cc72957d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:50.756646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:50.766675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 685/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:50.806242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038939-6531-497f-ae7d-8797d54e8f3c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:50.806571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038939-6531-497f-ae7d-8797d54e8f3c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:50.806836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038939-6531-497f-ae7d-8797d54e8f3c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:50.808312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 681/1366] 10.222.0.64 () {54 vars in 962 bytes} [Tue Jul 19 15:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:50.814008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea2431-7d2f-4d39-8193-3798fbe03cf8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:50.814393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea2431-7d2f-4d39-8193-3798fbe03cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:50.814755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea2431-7d2f-4d39-8193-3798fbe03cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:50.895520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8dea2431-7d2f-4d39-8193-3798fbe03cf8 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:50.896905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8dea2431-7d2f-4d39-8193-3798fbe03cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:51.023893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 686/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Tue Jul 19 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:51.032703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038939-6531-497f-ae7d-8797d54e8f3c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:51.034271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c9038939-6531-497f-ae7d-8797d54e8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:51.198504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038939-6531-497f-ae7d-8797d54e8f3c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:51.220919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:51.321750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:51.322540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:51.322900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:51.323250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:51.325041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:51.420407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:51.423158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0ab7-3c92-4bd6-a954-83cc0237d463 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:51.458642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 682/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:52.447566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662db298-9f79-4540-8643-917ff0e60c9a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:52.448110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662db298-9f79-4540-8643-917ff0e60c9a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:52.448110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662db298-9f79-4540-8643-917ff0e60c9a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:52.449673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 687/1369] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:52.455213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c900cd-90b9-469b-82df-dbb75932a235 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:52.455621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c900cd-90b9-469b-82df-dbb75932a235 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:52.455815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c900cd-90b9-469b-82df-dbb75932a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:52.486739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:52.527013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-14c900cd-90b9-469b-82df-dbb75932a235 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:52.529086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-14c900cd-90b9-469b-82df-dbb75932a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:52.638095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 683/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:52.991523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a62753-4d1b-4843-a8a2-903d45fddf0b None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:52.991523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a62753-4d1b-4843-a8a2-903d45fddf0b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:52.991523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a62753-4d1b-4843-a8a2-903d45fddf0b None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:52.991523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 688/1371] 10.222.0.64 () {54 vars in 964 bytes} [Tue Jul 19 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:52.996831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799b2d2-b63a-48ac-ab22-732d91138d69 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:52.997129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799b2d2-b63a-48ac-ab22-732d91138d69 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:52.997415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799b2d2-b63a-48ac-ab22-732d91138d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:53.078270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2799b2d2-b63a-48ac-ab22-732d91138d69 None None] MFA Rules not processed for user `ef1660a20af64b189516d5dd4b31a9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:53.079731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2799b2d2-b63a-48ac-ab22-732d91138d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:53.131835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:53.165973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 684/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Tue Jul 19 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:53.174329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a62753-4d1b-4843-a8a2-903d45fddf0b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:53.175944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d4a62753-4d1b-4843-a8a2-903d45fddf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:53.234864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:53.297663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a62753-4d1b-4843-a8a2-903d45fddf0b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:53.379131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:53.379783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:53.380071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:53.380349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:53.381995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:53.496530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:53.511875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:53.513334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9625-392c-421b-9c05-4cac17102ce6 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:53.534333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 689/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:53.615051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62bb2f-9288-4f9e-8420-f605f939809f None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:53.615526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62bb2f-9288-4f9e-8420-f605f939809f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:53.615526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62bb2f-9288-4f9e-8420-f605f939809f None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:53.616895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 685/1374] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:53.622582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4c7de-438a-4e5a-990a-c6db5ad05cd5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:53.623011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4c7de-438a-4e5a-990a-c6db5ad05cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:53.624126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4c7de-438a-4e5a-990a-c6db5ad05cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:53.705927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-20f4c7de-438a-4e5a-990a-c6db5ad05cd5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:53.707170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-20f4c7de-438a-4e5a-990a-c6db5ad05cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:53.815037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 690/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:37:53.861705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62bb2f-9288-4f9e-8420-f605f939809f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:53.863491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-af62bb2f-9288-4f9e-8420-f605f939809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:54.009518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62bb2f-9288-4f9e-8420-f605f939809f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:54.060449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:54.121898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:54.122578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:54.122869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:54.123148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:54.124873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:54.215994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:54.218252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33c621-574e-4b52-91eb-cf5e0f6836b6 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:54.236273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 686/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:56.321916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5172a0-2a35-4d3c-9f39-867ce23eb986 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:56.322455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5172a0-2a35-4d3c-9f39-867ce23eb986 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:56.322455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5172a0-2a35-4d3c-9f39-867ce23eb986 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:56.323825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 691/1377] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:37:56.329804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c53a-dcbb-4ed5-b4da-198006146753 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:56.330230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c53a-dcbb-4ed5-b4da-198006146753 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:56.330458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c53a-dcbb-4ed5-b4da-198006146753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:56.401283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-dda7c53a-dcbb-4ed5-b4da-198006146753 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:56.402619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dda7c53a-dcbb-4ed5-b4da-198006146753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:56.409656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:56.506106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 687/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:56.551010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5172a0-2a35-4d3c-9f39-867ce23eb986 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:56.552546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0d5172a0-2a35-4d3c-9f39-867ce23eb986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:56.635610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:56.725832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5172a0-2a35-4d3c-9f39-867ce23eb986 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:56.837060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:56.837711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:56.838000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:56.838278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:56.839998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:56.864672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:56.939720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:56.941525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16793580-3901-45e4-a390-fc5f497594f8 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:56.960328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 692/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:59.068310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423231-ee86-4a82-86f9-d337741623f4 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:59.068878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423231-ee86-4a82-86f9-d337741623f4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:59.068878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423231-ee86-4a82-86f9-d337741623f4 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:59.070435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 688/1380] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:37:59.075408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e26e7b-0697-4ae2-912a-e81adde7a21d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:59.075848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e26e7b-0697-4ae2-912a-e81adde7a21d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:59.075960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e26e7b-0697-4ae2-912a-e81adde7a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:59.146021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a8e26e7b-0697-4ae2-912a-e81adde7a21d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:59.147435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a8e26e7b-0697-4ae2-912a-e81adde7a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:59.256514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:59.265053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 693/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:59.309529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423231-ee86-4a82-86f9-d337741623f4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:59.311752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a3423231-ee86-4a82-86f9-d337741623f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:59.453382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:59.466221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423231-ee86-4a82-86f9-d337741623f4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:59.593633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:59.594287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:59.594608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:59.594893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:59.596564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:59.700417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:59.702247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd52d6-882b-4201-805c-552ca6053732 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:59.713517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:59.724230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 689/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:01.849751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca53f-c686-4496-b2c3-f2df89e8ca61 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:01.850300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca53f-c686-4496-b2c3-f2df89e8ca61 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:01.850576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca53f-c686-4496-b2c3-f2df89e8ca61 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:01.852370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 694/1383] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:01.857768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199628-7270-4e6a-b711-bca1632cc870 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:01.858910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199628-7270-4e6a-b711-bca1632cc870 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:01.859208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199628-7270-4e6a-b711-bca1632cc870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:01.942805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-be199628-7270-4e6a-b711-bca1632cc870 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:01.944644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-be199628-7270-4e6a-b711-bca1632cc870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:02.061660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 690/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:38:02.104038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca53f-c686-4496-b2c3-f2df89e8ca61 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:02.106028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-370ca53f-c686-4496-b2c3-f2df89e8ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:02.284753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca53f-c686-4496-b2c3-f2df89e8ca61 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:02.358490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:02.407132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:02.407799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:02.408125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:02.408409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:02.410111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:02.510618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:02.512236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170f95e-8a87-4b56-aa4c-4c0f2b67a8e0 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:02.531808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 695/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:04.653643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788436f-c29f-4dab-86f8-54684255e469 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:04.654210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788436f-c29f-4dab-86f8-54684255e469 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:04.654210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788436f-c29f-4dab-86f8-54684255e469 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:04.655928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 691/1386] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:04.663090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f55e-dce5-4a5f-bf4b-9487bc320262 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:04.663801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f55e-dce5-4a5f-bf4b-9487bc320262 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:04.664336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f55e-dce5-4a5f-bf4b-9487bc320262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:04.739599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2334f55e-dce5-4a5f-bf4b-9487bc320262 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:04.740829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2334f55e-dce5-4a5f-bf4b-9487bc320262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:04.773992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:04.843910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 696/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:38:04.890052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788436f-c29f-4dab-86f8-54684255e469 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:04.891629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a788436f-c29f-4dab-86f8-54684255e469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:04.986862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:05.072252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788436f-c29f-4dab-86f8-54684255e469 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:05.200289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:05.201092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:05.201740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:05.202170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:05.204352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:05.252855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:05.308569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:05.310197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe99e2-1af2-49d8-9c1c-f5b3d4a19f19 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:05.329444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 692/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:07.577684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e906f1-e628-4235-8630-a720564ff1e6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:07.578242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e906f1-e628-4235-8630-a720564ff1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:07.578242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e906f1-e628-4235-8630-a720564ff1e6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:07.579672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 697/1389] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:07.584926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9049-03e3-426e-b0c1-1cf2d6fbc6f1 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:07.585367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9049-03e3-426e-b0c1-1cf2d6fbc6f1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:07.585495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9049-03e3-426e-b0c1-1cf2d6fbc6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:07.649823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-147b9049-03e3-426e-b0c1-1cf2d6fbc6f1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:07.651063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-147b9049-03e3-426e-b0c1-1cf2d6fbc6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:07.751266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 693/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:07.796207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e906f1-e628-4235-8630-a720564ff1e6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:07.797787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-20e906f1-e628-4235-8630-a720564ff1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:07.949158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e906f1-e628-4235-8630-a720564ff1e6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:07.971987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:08.071148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:08.071713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:08.072000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:08.072309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:08.073989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:08.163978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:08.165590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e2e49-7b49-4d91-9997-1244ab9bd6a8 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:08.183812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 698/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:08.828426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296c550-adbe-4de9-9490-dbaebeb3e2f4 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:08.828975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296c550-adbe-4de9-9490-dbaebeb3e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:08.828975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296c550-adbe-4de9-9490-dbaebeb3e2f4 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:08.830377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 694/1392] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:38:08.835573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f7821-8fc2-44e5-9a91-d3eac61fc3f8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:08.836022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f7821-8fc2-44e5-9a91-d3eac61fc3f8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:08.836129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f7821-8fc2-44e5-9a91-d3eac61fc3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:08.860964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:08.903952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0a8f7821-8fc2-44e5-9a91-d3eac61fc3f8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:08.905369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0a8f7821-8fc2-44e5-9a91-d3eac61fc3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:09.002768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 699/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:09.058855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4981-8077-40f3-b27c-23fa3971f8ff None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:09.059150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4981-8077-40f3-b27c-23fa3971f8ff None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:09.059432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4981-8077-40f3-b27c-23fa3971f8ff None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:09.060895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 695/1394] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 19 15:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:09.066645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27e68-2b55-4d06-a1fd-8f1b72adb6fc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:09.066977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27e68-2b55-4d06-a1fd-8f1b72adb6fc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:09.067230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27e68-2b55-4d06-a1fd-8f1b72adb6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:09.143353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-34b27e68-2b55-4d06-a1fd-8f1b72adb6fc None None] MFA Rules not processed for user `58e091aa0ceb4548999be36c96c7dc04`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:09.144582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-34b27e68-2b55-4d06-a1fd-8f1b72adb6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:09.187252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:09.224503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 700/1395] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 19 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:09.232047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4981-8077-40f3-b27c-23fa3971f8ff None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:09.234179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-06ee4981-8077-40f3-b27c-23fa3971f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:09.251022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:09.346949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4981-8077-40f3-b27c-23fa3971f8ff None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:09.423571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:09.424222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:09.424507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:09.424788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:09.426555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:09.494562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:09.535690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:09.537135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4333a-dc83-4056-98ca-6b4252c67283 service glance] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:09.555487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 696/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:10.288043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed812e-af4a-4212-92d5-bfac57e70d3a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.288525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed812e-af4a-4212-92d5-bfac57e70d3a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.288728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed812e-af4a-4212-92d5-bfac57e70d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.294579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78446f-2e37-4552-be5c-9a0846266409 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.295010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78446f-2e37-4552-be5c-9a0846266409 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.295173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78446f-2e37-4552-be5c-9a0846266409 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.296730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 697/1397] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:38:10.301975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2f44-cdce-486b-b26b-6b16edb6e77c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.302334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2f44-cdce-486b-b26b-6b16edb6e77c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.302720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2f44-cdce-486b-b26b-6b16edb6e77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.355680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-39ed812e-af4a-4212-92d5-bfac57e70d3a None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:10.357074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-39ed812e-af4a-4212-92d5-bfac57e70d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:10.372906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-43bf2f44-cdce-486b-b26b-6b16edb6e77c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:10.375072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-43bf2f44-cdce-486b-b26b-6b16edb6e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:10.444490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 701/1398] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:10.475971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 698/1399] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:10.488872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f99470-8d4a-422e-8efe-93705e8bda44 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.489166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f99470-8d4a-422e-8efe-93705e8bda44 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.489446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f99470-8d4a-422e-8efe-93705e8bda44 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.490866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 702/1400] 10.222.0.64 () {54 vars in 943 bytes} [Tue Jul 19 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:10.497502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.497801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.498128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.520984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f99470-8d4a-422e-8efe-93705e8bda44 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:10.522628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-14f99470-8d4a-422e-8efe-93705e8bda44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:10.524035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:10.579471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] MFA Rules not processed for user `b06c607bcb83464791b3c0b965bce133`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:10.580750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:10.593121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:10.682871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f99470-8d4a-422e-8efe-93705e8bda44 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:10.694395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 699/1401] 10.222.0.64 () {58 vars in 1040 bytes} [Tue Jul 19 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:38:10.704398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:10.714030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5d306-fa8f-413a-bbc6-e38557bc56bc None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:10.786067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:10.802401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:10.803080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.803369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.803651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.805478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:10.822329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:10.823062 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:10.823353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:10.823635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:10.824840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:10.825468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:10.900280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:10.901910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8757144-36bd-4058-b1f0-005893b8f5d0 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:10.911078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:10.912713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7276e93-000f-4d0a-b95c-dc300f0760fb service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:10.920497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 703/1402] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:38:10.921138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 700/1403] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:38:13.065554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc69a7-2bcb-4e9c-acf3-1c7c7c1b968d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:13.066133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc69a7-2bcb-4e9c-acf3-1c7c7c1b968d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:13.066133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc69a7-2bcb-4e9c-acf3-1c7c7c1b968d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:13.067721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 704/1404] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:13.072876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b96-9fa0-4917-8a76-e95c234ef5a0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:13.073338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b96-9fa0-4917-8a76-e95c234ef5a0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:13.073447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b96-9fa0-4917-8a76-e95c234ef5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:13.146211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-84636b96-9fa0-4917-8a76-e95c234ef5a0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:13.147874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-84636b96-9fa0-4917-8a76-e95c234ef5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:13.210790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:13.270673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 701/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:13.313241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc69a7-2bcb-4e9c-acf3-1c7c7c1b968d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:13.315250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-01cc69a7-2bcb-4e9c-acf3-1c7c7c1b968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:13.483782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:13.486341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc69a7-2bcb-4e9c-acf3-1c7c7c1b968d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:13.612794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:13.614225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:13.615250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:13.615606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:13.617288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:13.718766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:13.720411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173da15-53bf-4d7d-b027-a5884f80a8ee service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:13.740062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 705/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:15.845293 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0696f-7468-4403-a736-3e0185a3db23 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:15.845865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0696f-7468-4403-a736-3e0185a3db23 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:15.845865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0696f-7468-4403-a736-3e0185a3db23 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:15.847534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 702/1407] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:15.852769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915fe2-a191-45f9-b12e-125d4728cdda None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:15.853210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915fe2-a191-45f9-b12e-125d4728cdda None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:15.853368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915fe2-a191-45f9-b12e-125d4728cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:15.856591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:15.931726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a3915fe2-a191-45f9-b12e-125d4728cdda None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:15.932979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a3915fe2-a191-45f9-b12e-125d4728cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:16.037950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 706/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:16.083266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0696f-7468-4403-a736-3e0185a3db23 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:16.084945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-22b0696f-7468-4403-a736-3e0185a3db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:16.261440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0696f-7468-4403-a736-3e0185a3db23 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:16.312273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:16.397318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:16.397962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:16.398245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:16.398663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:16.400334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:16.518902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:16.520939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b3ac4-6c84-4193-87a0-f1b4b2f103e0 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:16.545758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 703/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:26.036205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=64 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:26.542416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=79 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:33.337427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620e5e-8457-498a-aca6-34ce232ad964 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:33.337999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620e5e-8457-498a-aca6-34ce232ad964 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:33.337999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620e5e-8457-498a-aca6-34ce232ad964 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:33.339421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 707/1410] 10.222.0.64 () {54 vars in 918 bytes} [Tue Jul 19 15:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:33.345039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597ac7-2146-4aec-afb3-efaf15b43f1f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:33.345475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597ac7-2146-4aec-afb3-efaf15b43f1f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:33.345632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597ac7-2146-4aec-afb3-efaf15b43f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:33.419621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7a597ac7-2146-4aec-afb3-efaf15b43f1f None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:33.421384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7a597ac7-2146-4aec-afb3-efaf15b43f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:33.527829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 704/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 19 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:33.542734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aa9db-0efd-4acb-8ade-68bc987691bf None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:33.543032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aa9db-0efd-4acb-8ade-68bc987691bf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:33.543318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aa9db-0efd-4acb-8ade-68bc987691bf None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:33.545293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 708/1412] 10.222.0.64 () {54 vars in 918 bytes} [Tue Jul 19 15:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:33.550897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a3d74-9f83-4cb6-9254-e4301496183f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:33.551189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a3d74-9f83-4cb6-9254-e4301496183f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:33.551471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a3d74-9f83-4cb6-9254-e4301496183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:33.620875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:33.623581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ed2a3d74-9f83-4cb6-9254-e4301496183f None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:33.625313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ed2a3d74-9f83-4cb6-9254-e4301496183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:33.742982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 705/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 19 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:36.273722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d60d7-b383-4107-b332-bc8dcd220fed None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:36.274297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d60d7-b383-4107-b332-bc8dcd220fed None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:36.274297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d60d7-b383-4107-b332-bc8dcd220fed None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:36.275686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:38:36.281244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9465a2-f4d4-48c8-91e5-467d73963fd5 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:36.281659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9465a2-f4d4-48c8-91e5-467d73963fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:36.281819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9465a2-f4d4-48c8-91e5-467d73963fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:36.346811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ea9465a2-f4d4-48c8-91e5-467d73963fd5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:36.348038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ea9465a2-f4d4-48c8-91e5-467d73963fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:36.414524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:36.457245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:36.502977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d60d7-b383-4107-b332-bc8dcd220fed None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:36.504426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-825d60d7-b383-4107-b332-bc8dcd220fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:36.679986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d60d7-b383-4107-b332-bc8dcd220fed None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:36.761061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:36.810934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:36.811578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:36.811867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:36.812147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:36.813875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:36.916087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:36.917757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f21dd-ac6b-450f-a525-3dd26a6fa546 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:36.937194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 710/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:37.865475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf65d2-353d-44d0-b435-000fef47a502 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:37.866027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf65d2-353d-44d0-b435-000fef47a502 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:37.866027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf65d2-353d-44d0-b435-000fef47a502 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:37.867502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:37.873172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e1fb-fe26-431d-b252-62fbe7d5a542 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:37.873643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e1fb-fe26-431d-b252-62fbe7d5a542 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:37.874010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e1fb-fe26-431d-b252-62fbe7d5a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:37.949916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d5d4e1fb-fe26-431d-b252-62fbe7d5a542 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:37.951859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d5d4e1fb-fe26-431d-b252-62fbe7d5a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:37.978420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:38.049536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:38.203444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf65d2-353d-44d0-b435-000fef47a502 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:38.204961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-05cf65d2-353d-44d0-b435-000fef47a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:38.349223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf65d2-353d-44d0-b435-000fef47a502 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:38.392231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:38.476861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:38.477422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:38.477702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:38.477975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:38.479645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:38.568643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:38.570227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0a727-39bd-4ac3-a8a4-57aa68f61e43 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:38.587862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 708/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:39.484480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a43f3b-e827-4899-a522-32690c8e2d5e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:39.485066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a43f3b-e827-4899-a522-32690c8e2d5e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:39.485066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a43f3b-e827-4899-a522-32690c8e2d5e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:39.486448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:39.491382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9598e5c-a61c-4652-909b-d56ab5d2aab6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:39.491795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9598e5c-a61c-4652-909b-d56ab5d2aab6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:39.491956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9598e5c-a61c-4652-909b-d56ab5d2aab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:39.545827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:39.567433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c9598e5c-a61c-4652-909b-d56ab5d2aab6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:39.568666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c9598e5c-a61c-4652-909b-d56ab5d2aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:39.665417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:39.816074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a43f3b-e827-4899-a522-32690c8e2d5e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:39.817517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a6a43f3b-e827-4899-a522-32690c8e2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:39.968775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a43f3b-e827-4899-a522-32690c8e2d5e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:39.980775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:40.082687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:40.083518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:40.083640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:40.083909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:40.085636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:40.172220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:40.173827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb91b7-bfdf-4113-81d8-c50e43c6e5ca service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:40.192216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 713/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:41.062079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7df1-d97c-47a9-b469-844bf43f77f9 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:41.062615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7df1-d97c-47a9-b469-844bf43f77f9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:41.062615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7df1-d97c-47a9-b469-844bf43f77f9 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:41.063957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:38:41.068936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7d1f-e732-47cd-8b04-1d9e4fb7542b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:41.069452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7d1f-e732-47cd-8b04-1d9e4fb7542b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:41.069552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7d1f-e732-47cd-8b04-1d9e4fb7542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:41.088318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:41.146226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8e5c7d1f-e732-47cd-8b04-1d9e4fb7542b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:41.147475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8e5c7d1f-e732-47cd-8b04-1d9e4fb7542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:41.244034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:41.399102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7df1-d97c-47a9-b469-844bf43f77f9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:41.400618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d47e7df1-d97c-47a9-b469-844bf43f77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:41.509301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:41.545673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7df1-d97c-47a9-b469-844bf43f77f9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:41.657043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:41.657604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:41.657883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:41.658155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:41.659958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:41.736864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:41.750304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:41.751936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cc27b-3077-4132-9441-a1e8ab8a03e7 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:41.769719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 711/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:42.642278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d2cfc-5634-4918-aac4-9fa6e639cebe None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:42.642882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d2cfc-5634-4918-aac4-9fa6e639cebe None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:42.642882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d2cfc-5634-4918-aac4-9fa6e639cebe None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:42.644365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:42.649300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc99dae-4e00-4717-b7d2-1820870ad1fb None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:42.649766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc99dae-4e00-4717-b7d2-1820870ad1fb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:42.649868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc99dae-4e00-4717-b7d2-1820870ad1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:42.843260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-1bc99dae-4e00-4717-b7d2-1820870ad1fb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:42.844458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1bc99dae-4e00-4717-b7d2-1820870ad1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:42.937798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:43.085138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d2cfc-5634-4918-aac4-9fa6e639cebe None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:43.086743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fe9d2cfc-5634-4918-aac4-9fa6e639cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:43.173239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:43.235177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d2cfc-5634-4918-aac4-9fa6e639cebe None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:43.346228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:43.346893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:43.347178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:43.347451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:43.349090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:43.395869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:43.437171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:43.438832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d29085-60aa-42bf-bad7-e0fd683f521a service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:43.456990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 716/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:44.261287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35a03-767c-435a-93bf-e922748b59d9 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:44.261866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35a03-767c-435a-93bf-e922748b59d9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:44.261866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35a03-767c-435a-93bf-e922748b59d9 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:44.263900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:44.268845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20542e-6668-4ea4-bfb0-f834333b8db8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:44.269238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20542e-6668-4ea4-bfb0-f834333b8db8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:44.269416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20542e-6668-4ea4-bfb0-f834333b8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:44.346087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-da20542e-6668-4ea4-bfb0-f834333b8db8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:44.347375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-da20542e-6668-4ea4-bfb0-f834333b8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:44.561775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:44.718289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35a03-767c-435a-93bf-e922748b59d9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:44.719811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-acf35a03-767c-435a-93bf-e922748b59d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:44.768817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:44.866694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35a03-767c-435a-93bf-e922748b59d9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:44.981227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:44.982406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:44.982695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:44.983127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:44.984764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:44.991553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:45.074058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:45.076266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26daf81b-3f63-40b0-8410-a22807d468fc service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:45.094278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 714/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:45.897839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38efd-1d59-47e1-8c37-9dda9e377c85 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:45.898446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38efd-1d59-47e1-8c37-9dda9e377c85 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:45.898446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38efd-1d59-47e1-8c37-9dda9e377c85 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:45.899827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:45.905641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37164ea-6d6c-4856-a303-e15f3b0c065f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:45.906324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37164ea-6d6c-4856-a303-e15f3b0c065f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:45.906485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37164ea-6d6c-4856-a303-e15f3b0c065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:45.981371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c37164ea-6d6c-4856-a303-e15f3b0c065f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:45.982891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c37164ea-6d6c-4856-a303-e15f3b0c065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:46.053247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.088590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:46.238773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38efd-1d59-47e1-8c37-9dda9e377c85 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:46.240332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-70d38efd-1d59-47e1-8c37-9dda9e377c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:46.258814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.385856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38efd-1d59-47e1-8c37-9dda9e377c85 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:46.475307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.502636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:46.503277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:46.503559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:46.503833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:46.505467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:46.592383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:46.593967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04835a-c76f-4cc3-9f76-e28b4725e09e service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:46.612117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 719/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:47.431445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d223e7-8712-4be2-b8e0-e1947619413b None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:47.431987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d223e7-8712-4be2-b8e0-e1947619413b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:47.431987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d223e7-8712-4be2-b8e0-e1947619413b None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:47.433377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:47.439031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03167c-1d1e-4498-8653-b328cbe38a30 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:47.439462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03167c-1d1e-4498-8653-b328cbe38a30 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:47.439578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03167c-1d1e-4498-8653-b328cbe38a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:47.512946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9d03167c-1d1e-4498-8653-b328cbe38a30 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:47.514274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9d03167c-1d1e-4498-8653-b328cbe38a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:47.556514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:47.611442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:47.766505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d223e7-8712-4be2-b8e0-e1947619413b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:47.768057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-70d223e7-8712-4be2-b8e0-e1947619413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:47.913418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d223e7-8712-4be2-b8e0-e1947619413b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:47.967165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:48.026642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:48.027294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:48.027638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:48.027928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:48.030461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:48.120083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:48.121693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bd6ea-e85a-484e-931c-ea47c4f9aa1e service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:48.139936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 717/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:48.961862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790f6a-cfd5-40c9-9770-071063b1d7fc None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:48.962462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790f6a-cfd5-40c9-9770-071063b1d7fc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:48.962462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790f6a-cfd5-40c9-9770-071063b1d7fc None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:48.963861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:48.969061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037bb3-58a1-4ed0-aa6a-51a5fa29330e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:48.969496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037bb3-58a1-4ed0-aa6a-51a5fa29330e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:48.969621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037bb3-58a1-4ed0-aa6a-51a5fa29330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:49.043865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f8037bb3-58a1-4ed0-aa6a-51a5fa29330e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:49.045473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f8037bb3-58a1-4ed0-aa6a-51a5fa29330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:49.047512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:49.142994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:49.294121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99790f6a-cfd5-40c9-9770-071063b1d7fc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:49.295873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-99790f6a-cfd5-40c9-9770-071063b1d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:49.440791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99790f6a-cfd5-40c9-9770-071063b1d7fc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:49.466445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:49.554616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:49.555246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:49.555522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:49.555794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:49.557513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:49.645581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:49.647215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f020d7-8bd2-477f-ae57-07d5daea0757 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:49.665158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 722/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:51.637781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9bee7-294f-43b3-bdb6-d484bca1c1ff None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:51.638617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9bee7-294f-43b3-bdb6-d484bca1c1ff None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:51.638617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9bee7-294f-43b3-bdb6-d484bca1c1ff None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:51.639922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:51.645348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd019c2-dce5-49e0-b591-d15d3087ed0b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:51.645761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd019c2-dce5-49e0-b591-d15d3087ed0b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:51.645911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd019c2-dce5-49e0-b591-d15d3087ed0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:51.687710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:51.714176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4cd019c2-dce5-49e0-b591-d15d3087ed0b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:51.715430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4cd019c2-dce5-49e0-b591-d15d3087ed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:51.814819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:38:51.853066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9bee7-294f-43b3-bdb6-d484bca1c1ff None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:51.854637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6bf9bee7-294f-43b3-bdb6-d484bca1c1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:51.956285 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9bee7-294f-43b3-bdb6-d484bca1c1ff None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:51.991616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:52.033051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:52.033695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:52.033981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:52.034257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:52.035948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:52.143575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:52.145009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccee84-64fc-42f0-a35b-f08509f6073c service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:52.164047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 720/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:54.358287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3be9d-4172-4820-b442-32eb25509545 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:54.358852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3be9d-4172-4820-b442-32eb25509545 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:54.358852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3be9d-4172-4820-b442-32eb25509545 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:54.360233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:54.365575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2d5ce-c38b-4725-8109-563458c2bb43 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:54.365955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2d5ce-c38b-4725-8109-563458c2bb43 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:54.366147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2d5ce-c38b-4725-8109-563458c2bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:54.438950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d5c2d5ce-c38b-4725-8109-563458c2bb43 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:54.440170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d5c2d5ce-c38b-4725-8109-563458c2bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:54.453178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:54.537516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:54.575879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3be9d-4172-4820-b442-32eb25509545 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:54.577418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-81d3be9d-4172-4820-b442-32eb25509545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:54.680080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3be9d-4172-4820-b442-32eb25509545 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:54.692887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:54.763605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:54.764247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:54.764530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:54.764805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:54.766484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:54.875359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:54.876804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f10676-c3af-478a-b496-53e0e2a5949c service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:54.895232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 725/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:57.259746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206ff9-82a8-4048-a276-acc4b12e40c6 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:57.260290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206ff9-82a8-4048-a276-acc4b12e40c6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:57.260290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206ff9-82a8-4048-a276-acc4b12e40c6 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:57.261733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:57.267659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4716a-9753-4f71-ab9d-573050912161 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:57.268121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4716a-9753-4f71-ab9d-573050912161 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:57.268256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4716a-9753-4f71-ab9d-573050912161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:57.315802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:57.334324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-efb4716a-9753-4f71-ab9d-573050912161 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:57.335567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-efb4716a-9753-4f71-ab9d-573050912161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:57.431417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:57.470408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a206ff9-82a8-4048-a276-acc4b12e40c6 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:57.471977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2a206ff9-82a8-4048-a276-acc4b12e40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:57.573695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a206ff9-82a8-4048-a276-acc4b12e40c6 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:57.613093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:57.647747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:57.648387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:57.648671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:57.648949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:57.650677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:57.758998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:57.760442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6510b7-6bb7-4919-8392-9c4ecf826498 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:57.780029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 723/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:38:59.941211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6d40-f645-4fe5-85c8-675b79cfd1ce None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:59.941788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6d40-f645-4fe5-85c8-675b79cfd1ce None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:59.941788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6d40-f645-4fe5-85c8-675b79cfd1ce None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:59.943186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:38:59.948548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e761b7-60cf-4839-879e-29bec41b589a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:59.948973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e761b7-60cf-4839-879e-29bec41b589a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:59.949103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e761b7-60cf-4839-879e-29bec41b589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:00.011843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e2e761b7-60cf-4839-879e-29bec41b589a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:00.013169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e2e761b7-60cf-4839-879e-29bec41b589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:00.033197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:00.109424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:00.148444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6d40-f645-4fe5-85c8-675b79cfd1ce None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:00.149983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f45f6d40-f645-4fe5-85c8-675b79cfd1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:00.255227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6d40-f645-4fe5-85c8-675b79cfd1ce None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:00.274798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:00.331128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:00.331780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:00.332068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:00.332350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:00.334010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:00.444278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:00.445719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad231209-1fa4-438a-8915-1129b63fac4d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:00.464814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 728/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:02.576164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839323f-b50a-4c87-833c-7890056be4e5 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:02.576732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839323f-b50a-4c87-833c-7890056be4e5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:02.576732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839323f-b50a-4c87-833c-7890056be4e5 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:02.578250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:02.583537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e944c-fbef-4c15-a9dc-55ef65851143 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:02.583971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e944c-fbef-4c15-a9dc-55ef65851143 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:02.584092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e944c-fbef-4c15-a9dc-55ef65851143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:02.645568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:02.648566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-520e944c-fbef-4c15-a9dc-55ef65851143 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:02.650481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-520e944c-fbef-4c15-a9dc-55ef65851143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:02.753430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:02.792577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839323f-b50a-4c87-833c-7890056be4e5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:02.794784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2839323f-b50a-4c87-833c-7890056be4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:02.896873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839323f-b50a-4c87-833c-7890056be4e5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:02.945095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:02.971044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:02.971698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:02.971986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:02.972267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:02.973927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:03.082704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:03.084134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c9a3-21ad-41d6-adf8-9087d3f24728 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:03.102836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 726/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:05.201752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86735f-6fe0-4aca-8aac-cdb68747dabe None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.202324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86735f-6fe0-4aca-8aac-cdb68747dabe None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.202324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86735f-6fe0-4aca-8aac-cdb68747dabe None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.203724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:05.209486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770e90-2dde-4815-a535-4654c3b439cc None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.209920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770e90-2dde-4815-a535-4654c3b439cc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.210076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770e90-2dde-4815-a535-4654c3b439cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.274946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6d770e90-2dde-4815-a535-4654c3b439cc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:05.276157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6d770e90-2dde-4815-a535-4654c3b439cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.305638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:05.372798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:05.415509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86735f-6fe0-4aca-8aac-cdb68747dabe None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.417074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ca86735f-6fe0-4aca-8aac-cdb68747dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.523843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86735f-6fe0-4aca-8aac-cdb68747dabe None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.552443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:05.598566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.599218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.599506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.599784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.601436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.709850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.711359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec0976-b8d6-43fa-a49a-5738018441e3 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.729447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 731/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:07.909082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4dfc5-6d7c-460b-81aa-23f4d1769e24 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:07.909664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4dfc5-6d7c-460b-81aa-23f4d1769e24 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:07.909664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4dfc5-6d7c-460b-81aa-23f4d1769e24 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:07.911059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:07.916403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84593ff-d3b6-4970-b097-c599ed38aad8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:07.916832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84593ff-d3b6-4970-b097-c599ed38aad8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:07.916973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84593ff-d3b6-4970-b097-c599ed38aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:07.980295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b84593ff-d3b6-4970-b097-c599ed38aad8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:07.982168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b84593ff-d3b6-4970-b097-c599ed38aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:07.990462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:08.080651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:08.118576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4dfc5-6d7c-460b-81aa-23f4d1769e24 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:08.120143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a2e4dfc5-6d7c-460b-81aa-23f4d1769e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:08.223700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4dfc5-6d7c-460b-81aa-23f4d1769e24 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:08.278343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:08.297600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:08.298247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:08.298567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:08.298851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:08.300513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:08.409498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:08.410976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270db94b-e941-465e-8dcd-2717fa22745f service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:08.429652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 729/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:10.560691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e635d-07af-4670-bce3-e1f08765a003 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:10.561302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e635d-07af-4670-bce3-e1f08765a003 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:10.561302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e635d-07af-4670-bce3-e1f08765a003 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:10.562729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:10.568155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba830c-c2b3-407a-b22d-43cfa6d830b7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:10.568592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba830c-c2b3-407a-b22d-43cfa6d830b7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:10.568710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba830c-c2b3-407a-b22d-43cfa6d830b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:10.634052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-69ba830c-c2b3-407a-b22d-43cfa6d830b7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:10.635307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-69ba830c-c2b3-407a-b22d-43cfa6d830b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:10.674449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:10.733702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:10.772278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e635d-07af-4670-bce3-e1f08765a003 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:10.773813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f24e635d-07af-4670-bce3-e1f08765a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:10.877975 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e635d-07af-4670-bce3-e1f08765a003 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:10.915312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:10.952186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:10.952829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:10.953108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:10.953379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:10.955041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:11.061114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:11.062562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73a90e-e015-46f3-837f-4816d9ca112f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:11.081078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 734/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:13.132449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27c98-bcf6-4e18-8092-f3cfc890a9b9 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:13.133026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27c98-bcf6-4e18-8092-f3cfc890a9b9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:13.133026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27c98-bcf6-4e18-8092-f3cfc890a9b9 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:13.134407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:13.140299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300ddd-6416-4a13-a712-70216d61553a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:13.140715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300ddd-6416-4a13-a712-70216d61553a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:13.140867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300ddd-6416-4a13-a712-70216d61553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:13.206824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e1300ddd-6416-4a13-a712-70216d61553a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:13.208083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e1300ddd-6416-4a13-a712-70216d61553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:13.226526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:13.304833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:13.342732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27c98-bcf6-4e18-8092-f3cfc890a9b9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:13.344263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3ed27c98-bcf6-4e18-8092-f3cfc890a9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:13.447033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27c98-bcf6-4e18-8092-f3cfc890a9b9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:13.513873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:13.521193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:13.521842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:13.522133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:13.522448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:13.524101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:13.633336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:13.634854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970cdd5-4b2d-4d06-952c-ee2d527009b9 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:13.653048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 732/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:15.765835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca305-dca3-4f62-b714-6d617bac7eed None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:15.766445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca305-dca3-4f62-b714-6d617bac7eed None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:15.766445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca305-dca3-4f62-b714-6d617bac7eed None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:15.767804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:15.773231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e3dac-a138-4db4-bb4e-e7fdf9642aa9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:15.773686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e3dac-a138-4db4-bb4e-e7fdf9642aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:15.773835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e3dac-a138-4db4-bb4e-e7fdf9642aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:15.838732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-113e3dac-a138-4db4-bb4e-e7fdf9642aa9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:15.839955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-113e3dac-a138-4db4-bb4e-e7fdf9642aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:15.889234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:15.937831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:15.974550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ca305-dca3-4f62-b714-6d617bac7eed None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:15.976307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fd3ca305-dca3-4f62-b714-6d617bac7eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:16.078500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ca305-dca3-4f62-b714-6d617bac7eed None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:16.124442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:16.150288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:16.150968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:16.151255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:16.151533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:16.153405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:16.269634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:16.271115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0883-5173-432f-8a49-9851453ca656 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:16.289578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 737/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:25.936007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=22 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:26.287175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=66 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:36.174259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a00f4-184f-4649-9222-f4fb71c1a55c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:36.175225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a00f4-184f-4649-9222-f4fb71c1a55c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:36.175225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a00f4-184f-4649-9222-f4fb71c1a55c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:36.176915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 734/1471] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:36.182448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978383e2-d7b9-4efd-964e-3ad3d9d63d3f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:36.182871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978383e2-d7b9-4efd-964e-3ad3d9d63d3f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:36.183018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978383e2-d7b9-4efd-964e-3ad3d9d63d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:36.247626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-978383e2-d7b9-4efd-964e-3ad3d9d63d3f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:36.248841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-978383e2-d7b9-4efd-964e-3ad3d9d63d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:36.347193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 738/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:36.438384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562904b5-706b-489a-8e39-6f03787844a3 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:36.438668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562904b5-706b-489a-8e39-6f03787844a3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:36.438971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562904b5-706b-489a-8e39-6f03787844a3 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:36.440368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 735/1473] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 19 15:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:36.445091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a0846-2fdc-4b46-af89-afeb7476e1ef None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:36.445386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a0846-2fdc-4b46-af89-afeb7476e1ef None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:36.445669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a0846-2fdc-4b46-af89-afeb7476e1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:36.526782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-066a0846-2fdc-4b46-af89-afeb7476e1ef None None] MFA Rules not processed for user `58e091aa0ceb4548999be36c96c7dc04`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:36.529717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-066a0846-2fdc-4b46-af89-afeb7476e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:36.560408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:36.627863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 739/1474] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 19 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:36.635951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562904b5-706b-489a-8e39-6f03787844a3 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:36.637989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-562904b5-706b-489a-8e39-6f03787844a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:36.775113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562904b5-706b-489a-8e39-6f03787844a3 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:36.866295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:36.866978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:36.867264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:36.867592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:36.869213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:36.933420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:36.995502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:36.998021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2c33-557c-4711-bf1c-cd714d2af75a service glance] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:37.018940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 736/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:39.205106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82658-9b3c-4166-ae52-4190d28c7656 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:39.205642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82658-9b3c-4166-ae52-4190d28c7656 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:39.205740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82658-9b3c-4166-ae52-4190d28c7656 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:39.207089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 740/1476] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:39.212370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2327-e40c-4409-94e4-e2281eba5341 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:39.212806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2327-e40c-4409-94e4-e2281eba5341 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:39.212920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2327-e40c-4409-94e4-e2281eba5341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:39.276593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ce4f2327-e40c-4409-94e4-e2281eba5341 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:39.277895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ce4f2327-e40c-4409-94e4-e2281eba5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:39.373755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 737/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:39.397303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae82658-9b3c-4166-ae52-4190d28c7656 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:39.398862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7ae82658-9b3c-4166-ae52-4190d28c7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:39.524116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae82658-9b3c-4166-ae52-4190d28c7656 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:39.573801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:39.619073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:39.619732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:39.620019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:39.620297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:39.621091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:39.622857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:39:39.622857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:39:39.622857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:39:39.623997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e802d-d7ee-4e80-8914-5d27ea356ca8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:39.642967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 741/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 19 15:39:39 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:39:41.722752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203779d8-d346-4f26-b3ed-c24b7843cbac None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:41.723253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203779d8-d346-4f26-b3ed-c24b7843cbac None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:41.723372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203779d8-d346-4f26-b3ed-c24b7843cbac None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:41.724661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 738/1479] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:41.729888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dfb60-9e9a-4295-b5c9-009420dea64a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:41.730498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dfb60-9e9a-4295-b5c9-009420dea64a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:41.730498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dfb60-9e9a-4295-b5c9-009420dea64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:41.794478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-af8dfb60-9e9a-4295-b5c9-009420dea64a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:41.795699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-af8dfb60-9e9a-4295-b5c9-009420dea64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:41.893416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 742/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:41.937026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203779d8-d346-4f26-b3ed-c24b7843cbac None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:41.938563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-203779d8-d346-4f26-b3ed-c24b7843cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:41.948008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:42.082540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203779d8-d346-4f26-b3ed-c24b7843cbac None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:42.161071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:42.194727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:42.195377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:42.195665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:42.195946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:42.197598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:42.284211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:42.285799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15da3-b209-42ea-abf9-3b810c0ad9dd service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:42.303967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 739/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:44.544239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7ba5-a46f-4785-87e0-7a8882a349e3 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:44.544804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7ba5-a46f-4785-87e0-7a8882a349e3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:44.544804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7ba5-a46f-4785-87e0-7a8882a349e3 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:44.546175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 743/1482] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:44.551740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776129a-b38e-41c1-84b5-36ccc77956f9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:44.552130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776129a-b38e-41c1-84b5-36ccc77956f9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:44.552300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776129a-b38e-41c1-84b5-36ccc77956f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:44.619873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f776129a-b38e-41c1-84b5-36ccc77956f9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:44.621665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f776129a-b38e-41c1-84b5-36ccc77956f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:44.667465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:44.718267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 740/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:44.755666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7ba5-a46f-4785-87e0-7a8882a349e3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:44.757217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-462e7ba5-a46f-4785-87e0-7a8882a349e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:44.780827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:44.861354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7ba5-a46f-4785-87e0-7a8882a349e3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:44.934760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:44.935407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:44.935697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:44.935979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:44.937630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:45.015254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:45.050967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:45.052431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206c26c-6f0a-4189-a4b1-e3f1ac72eb4e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:45.071602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 744/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:47.158051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc422c-357d-4d11-8057-b458d75d55b5 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:47.158650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc422c-357d-4d11-8057-b458d75d55b5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:47.158650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc422c-357d-4d11-8057-b458d75d55b5 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:47.160044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 741/1485] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:47.165289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30ec9e-912a-4193-a546-12ec1341decd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:47.165733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30ec9e-912a-4193-a546-12ec1341decd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:47.165843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30ec9e-912a-4193-a546-12ec1341decd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:47.228874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6e30ec9e-912a-4193-a546-12ec1341decd None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:47.230679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6e30ec9e-912a-4193-a546-12ec1341decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:47.325729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 745/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:47.364574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc422c-357d-4d11-8057-b458d75d55b5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:47.366100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0ebc422c-357d-4d11-8057-b458d75d55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:47.468870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc422c-357d-4d11-8057-b458d75d55b5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:47.540278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:47.542146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:47.542932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:47.543441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:47.543779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:47.545904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:47.656612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:47.658061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53465-1edd-4e37-8e8e-4dc84c952558 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:47.676763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 742/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:49.872974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4056-da2f-4dad-a56e-168e442315f8 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:49.873538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4056-da2f-4dad-a56e-168e442315f8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:49.873538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4056-da2f-4dad-a56e-168e442315f8 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:49.874997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 746/1488] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:49.880166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1358ff-a365-4016-bd06-7270e6a93ba6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:49.880567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1358ff-a365-4016-bd06-7270e6a93ba6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:49.880732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1358ff-a365-4016-bd06-7270e6a93ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:49.944691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ed1358ff-a365-4016-bd06-7270e6a93ba6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:49.945913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ed1358ff-a365-4016-bd06-7270e6a93ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:50.000545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:50.045336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 743/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:50.086553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e4056-da2f-4dad-a56e-168e442315f8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:50.088096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a01e4056-da2f-4dad-a56e-168e442315f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:50.126198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:50.194744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e4056-da2f-4dad-a56e-168e442315f8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:50.271569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:50.272228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:50.272513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:50.272789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:50.274468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:50.353777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:50.382279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:50.383715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd15e-46d2-4bbb-a1a1-df5f94d87e63 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:50.403252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 747/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:52.648288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516066f-597e-4e82-8aee-702fca74b377 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:52.648866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516066f-597e-4e82-8aee-702fca74b377 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:52.648866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516066f-597e-4e82-8aee-702fca74b377 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:52.650248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 744/1491] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 19 15:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:52.656412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada207c9-58bc-498f-8424-84b589b428a3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:52.656864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada207c9-58bc-498f-8424-84b589b428a3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:52.656970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada207c9-58bc-498f-8424-84b589b428a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:52.721863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ada207c9-58bc-498f-8424-84b589b428a3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:52.723108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ada207c9-58bc-498f-8424-84b589b428a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:52.818609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 748/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 19 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:52.859310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516066f-597e-4e82-8aee-702fca74b377 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:52.860850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8516066f-597e-4e82-8aee-702fca74b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:52.965266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516066f-597e-4e82-8aee-702fca74b377 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:53.037727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:53.038397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:53.038688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:53.038975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:53.040620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:53.050480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:53.150555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:53.152766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337474e-1aa4-4a86-9bf1-94a9a2cc6591 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:53.171168 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 745/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:40:02.816762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=82 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:03.168817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=50 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:22.457796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:22.458418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:22.458418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:22.533221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:22.534443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:22.630455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 749/1494] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:22.639342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:22.639850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:22.639956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:22.714923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:22.716073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:22.812655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 746/1495] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:22.817309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:22.818550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:22.830035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382b52-4415-486e-9774-c0ee59cc1284 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:22.890241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:22.924682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:22.925337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:22.925618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:22.925892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:22.926649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:41:22.926957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:22.927968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:22.927968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:41:22.927968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:41:22.928844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:22.940671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 750/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:41:22.948869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:22.958138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbb2b0-b772-49ed-a323-158e33e0a63d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:23.023862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:23.058536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:23.059200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.059515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.059793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.060491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:23.062220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:23.062220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:41:23.062220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:41:23.063449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:23.119275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 747/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:41:23.123503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:23.125139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:23.159516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538495f-2351-445f-8fb9-a8dbad8251fb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:23.253266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:23.253937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.254224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.254539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.255239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:23.256254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:23.256254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:41:23.256254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:41:23.257455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:23.299126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 751/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:41:23 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:41:23.302993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:23.304545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:23.367602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198d9e1-559f-4a05-88c1-29fe90802108 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:23.449910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:23.461494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:23.462711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.462997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.463277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.464004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:23.465023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:23.465023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:41:23.465023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:41:23.465912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:23.478793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 748/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:41:23.482827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:23.484358 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:23.495910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bc2b9-f525-4da7-aaec-7f96853e4c67 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:23.520980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:23.592693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:23.593388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.593676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.593955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.594706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:23.595730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:23.595730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:41:23.595730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:41:23.596610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e4c2-66c9-4b06-bba7-e9317bb75470 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:23.609518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 752/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:41:23.613735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:23.615353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:23.648964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2865b8-b3e4-4d65-b94e-0c7529705247 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:23.745271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:23.746156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.746468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.746747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] PATH_INFO: `/v3/projects/956d262891534604ad5629cdf3ec28c6/users/e133403da1064892bcc634e13bdb7c14/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.768397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] RBAC: Authorizing `identity:create_grant(project_id=956d262891534604ad5629cdf3ec28c6, user_id=e133403da1064892bcc634e13bdb7c14, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:23.769427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:23.769427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:41:23.769427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:41:23.771389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3a645-f0de-490b-907a-5e167a2087af admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:23.799284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 749/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:41:23 2022] PUT /identity/v3/projects/956d262891534604ad5629cdf3ec28c6/users/e133403da1064892bcc634e13bdb7c14/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:23.812137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87de19-359c-424c-8272-528124249dba None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.812433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87de19-359c-424c-8272-528124249dba None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.812720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87de19-359c-424c-8272-528124249dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.869374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bb87de19-359c-424c-8272-528124249dba None None] MFA Rules not processed for user `e133403da1064892bcc634e13bdb7c14`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:23.870552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb87de19-359c-424c-8272-528124249dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:23.948454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 753/1502] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:23.963657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677087d2-a1f4-49ed-a55e-91e8a1b0f109 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.963657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677087d2-a1f4-49ed-a55e-91e8a1b0f109 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.964073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677087d2-a1f4-49ed-a55e-91e8a1b0f109 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:23.965355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 750/1503] 10.222.0.64 () {54 vars in 964 bytes} [Tue Jul 19 15:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:41:23.970874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef48f4f-f023-4680-9a1a-e3446ba84e91 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:23.971169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef48f4f-f023-4680-9a1a-e3446ba84e91 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:23.972130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef48f4f-f023-4680-9a1a-e3446ba84e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:24.005487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:24.061638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2ef48f4f-f023-4680-9a1a-e3446ba84e91 None None] MFA Rules not processed for user `ef1660a20af64b189516d5dd4b31a9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:24.062902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2ef48f4f-f023-4680-9a1a-e3446ba84e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:24.138188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 754/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Tue Jul 19 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:24.146140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677087d2-a1f4-49ed-a55e-91e8a1b0f109 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:24.147739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-677087d2-a1f4-49ed-a55e-91e8a1b0f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:24.203344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:24.257635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677087d2-a1f4-49ed-a55e-91e8a1b0f109 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:24.332151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:24.332806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:24.333111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:24.333375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:24.335059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:24.436201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:24.437581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:24.442940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:24.458071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 751/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:24.500566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a581a-26d5-4503-bf49-051c7215209d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:24.500988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a581a-26d5-4503-bf49-051c7215209d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:24.501137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a581a-26d5-4503-bf49-051c7215209d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:24.502486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 755/1506] 10.222.0.64 () {52 vars in 829 bytes} [Tue Jul 19 15:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:41:24.505925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:24.507162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:24.606206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9cd9-730c-4940-aeb1-979f14d1c144 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:24.704570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:24.706252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:24.706760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:24.707196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] PATH_INFO: `/v3/users/e133403da1064892bcc634e13bdb7c14` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:24.721181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e133403da1064892bcc634e13bdb7c14)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:24.722583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:24.722583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:41:24.722583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:41:24.724189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:24.735338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:24.793208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e133403da1064892bcc634e13bdb7c14'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:24.793758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e133403da1064892bcc634e13bdb7c14'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:24.806921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e133403da1064892bcc634e13bdb7c14'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:24.807400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e133403da1064892bcc634e13bdb7c14'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:24.817281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e133403da1064892bcc634e13bdb7c14'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:24.842854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 752/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:41:24 2022] DELETE /identity/v3/users/e133403da1064892bcc634e13bdb7c14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:24.847407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:24.847776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:24.848135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:24.906605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:24.908498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:24.987830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:25.005111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 756/1508] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:41:25.015552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:25.016776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:25.118824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e7af0-97aa-479d-a0d0-53866a398fbe admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:25.173235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:25.194724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:25.195372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:25.195662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:25.195942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:25.198086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:25.308077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:25.309442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e3d1-0def-4a15-aeba-93c025990790 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:25.327941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 753/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:25.661447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:25.662896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:25.675578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c05020-fcd1-4656-ada3-8f617dd5937e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:25.770892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:25.771753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:25.772039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:25.772319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] PATH_INFO: `/v3/projects/956d262891534604ad5629cdf3ec28c6` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:25.783300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956d262891534604ad5629cdf3ec28c6)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:25.784341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:41:25.784341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:41:25.784341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:41:25.785536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:25.842284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956d262891534604ad5629cdf3ec28c6', 'request_id': 'req-b5b5200e-8984-494a-ba88-bc144377c238'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:25.848314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956d262891534604ad5629cdf3ec28c6', 'request_id': 'req-b5b5200e-8984-494a-ba88-bc144377c238'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:25.861319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956d262891534604ad5629cdf3ec28c6', 'request_id': 'req-b5b5200e-8984-494a-ba88-bc144377c238'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:25.886930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] The token cache is being invalidate because project 956d262891534604ad5629cdf3ec28c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:41:25.887226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:25.887755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b5b5200e-8984-494a-ba88-bc144377c238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:25.889129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 757/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:41:25 2022] DELETE /identity/v3/projects/956d262891534604ad5629cdf3ec28c6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:35.325692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=62 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:35.884384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:03.235067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56942af-ad97-4b0e-a118-9b020edacc78 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:03.235675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56942af-ad97-4b0e-a118-9b020edacc78 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:03.235675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56942af-ad97-4b0e-a118-9b020edacc78 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:03.237090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:03.241869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09e12-f1a0-404b-9aef-59a847eb82a8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:03.242263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09e12-f1a0-404b-9aef-59a847eb82a8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:03.242476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09e12-f1a0-404b-9aef-59a847eb82a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:03.320636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a9c09e12-f1a0-404b-9aef-59a847eb82a8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:03.321843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a9c09e12-f1a0-404b-9aef-59a847eb82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:03.427829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:03.581672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56942af-ad97-4b0e-a118-9b020edacc78 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:03.583828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c56942af-ad97-4b0e-a118-9b020edacc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:03.704991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56942af-ad97-4b0e-a118-9b020edacc78 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:03.710451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fced70-ee5d-4f73-b852-ab05705a999e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:03.711096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fced70-ee5d-4f73-b852-ab05705a999e service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:03.711381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fced70-ee5d-4f73-b852-ab05705a999e service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:03.711660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fced70-ee5d-4f73-b852-ab05705a999e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:03.720175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fced70-ee5d-4f73-b852-ab05705a999e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:03.721762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fced70-ee5d-4f73-b852-ab05705a999e service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:03.731635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 755/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:04.562910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffd90-0ace-4562-957f-84c92ba3c853 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:04.562910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffd90-0ace-4562-957f-84c92ba3c853 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:04.563966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffd90-0ace-4562-957f-84c92ba3c853 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:04.565330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:04.570175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419801bd-d509-4b6d-b759-88e25c679caf None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:04.570704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419801bd-d509-4b6d-b759-88e25c679caf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:04.570793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419801bd-d509-4b6d-b759-88e25c679caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:04.589185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-419801bd-d509-4b6d-b759-88e25c679caf None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:04.590512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-419801bd-d509-4b6d-b759-88e25c679caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:04.598340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:04.752945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ffd90-0ace-4562-957f-84c92ba3c853 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:04.767631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ffd90-0ace-4562-957f-84c92ba3c853 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:04.773079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff959-8910-4d99-9021-d3caf40ad8cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:04.773729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff959-8910-4d99-9021-d3caf40ad8cf service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:04.774016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff959-8910-4d99-9021-d3caf40ad8cf service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:04.774294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff959-8910-4d99-9021-d3caf40ad8cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:04.783264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff959-8910-4d99-9021-d3caf40ad8cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:04.784857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff959-8910-4d99-9021-d3caf40ad8cf service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:04.795048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 760/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:05.497881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8757110-a545-4e99-adaf-b1e4c26e8d80 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:05.498178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8757110-a545-4e99-adaf-b1e4c26e8d80 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:05.498502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8757110-a545-4e99-adaf-b1e4c26e8d80 None None] PATH_INFO: `/v3` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:05.499862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 757/1517] 10.222.0.36 () {54 vars in 925 bytes} [Tue Jul 19 15:43:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:43:05.506009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5a89-9140-45ec-b1ee-9bcf63fe62c2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:05.506304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5a89-9140-45ec-b1ee-9bcf63fe62c2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:05.506610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5a89-9140-45ec-b1ee-9bcf63fe62c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:05.565144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2dee5a89-9140-45ec-b1ee-9bcf63fe62c2 None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:05.566347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2dee5a89-9140-45ec-b1ee-9bcf63fe62c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:05.582733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:05.637175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 761/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 19 15:43:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:09.379635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe4c7c-e5e8-4ec5-ad18-51027d4d5522 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:09.380176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe4c7c-e5e8-4ec5-ad18-51027d4d5522 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:09.380176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe4c7c-e5e8-4ec5-ad18-51027d4d5522 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:09.381454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 758/1519] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 19 15:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:09.386333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210be28-c53d-4984-9aa0-cc8a9bfe1daf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:09.386829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210be28-c53d-4984-9aa0-cc8a9bfe1daf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:09.386985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210be28-c53d-4984-9aa0-cc8a9bfe1daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:09.405558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0210be28-c53d-4984-9aa0-cc8a9bfe1daf None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:09.408900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0210be28-c53d-4984-9aa0-cc8a9bfe1daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:09.418331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 762/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 19 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:09.425916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe4c7c-e5e8-4ec5-ad18-51027d4d5522 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:09.439818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe4c7c-e5e8-4ec5-ad18-51027d4d5522 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:09.444665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa8110-87b0-4770-95cd-cb53064602d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:09.445292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8110-87b0-4770-95cd-cb53064602d1 service placement] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:09.445575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8110-87b0-4770-95cd-cb53064602d1 service placement] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:09.445851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8110-87b0-4770-95cd-cb53064602d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:09.454036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa8110-87b0-4770-95cd-cb53064602d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:09.455652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa8110-87b0-4770-95cd-cb53064602d1 service placement] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:09.465695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 759/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:16.038402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d637d-1c35-4c3b-bb57-82e638f91275 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:16.038953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d637d-1c35-4c3b-bb57-82e638f91275 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:16.038953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d637d-1c35-4c3b-bb57-82e638f91275 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:16.040278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:16.045274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3d5e-c9cd-49cc-b44a-aa2977b88bc6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:16.045714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3d5e-c9cd-49cc-b44a-aa2977b88bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:16.045841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3d5e-c9cd-49cc-b44a-aa2977b88bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:16.063477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f53e3d5e-c9cd-49cc-b44a-aa2977b88bc6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:16.064657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f53e3d5e-c9cd-49cc-b44a-aa2977b88bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:16.072398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:16.228144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d637d-1c35-4c3b-bb57-82e638f91275 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:16.248309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d637d-1c35-4c3b-bb57-82e638f91275 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:16.253707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc1ab1-7123-4fcd-9a26-bbcc75f55a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:16.254343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1ab1-7123-4fcd-9a26-bbcc75f55a2b service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:16.254652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1ab1-7123-4fcd-9a26-bbcc75f55a2b service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:16.254930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1ab1-7123-4fcd-9a26-bbcc75f55a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:16.263750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc1ab1-7123-4fcd-9a26-bbcc75f55a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:16.265314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc1ab1-7123-4fcd-9a26-bbcc75f55a2b service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:16.274549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 764/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:17.097304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aa292-30d5-4188-89de-09ed8599b87c None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:17.097855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aa292-30d5-4188-89de-09ed8599b87c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:17.097855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aa292-30d5-4188-89de-09ed8599b87c None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:17.099284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:17.104137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcc174-0609-41f2-b5ba-e38387f87899 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:17.104558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcc174-0609-41f2-b5ba-e38387f87899 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:17.104671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcc174-0609-41f2-b5ba-e38387f87899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:17.122815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e4bcc174-0609-41f2-b5ba-e38387f87899 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:17.124003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e4bcc174-0609-41f2-b5ba-e38387f87899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:17.132383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:17.282459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aa292-30d5-4188-89de-09ed8599b87c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:17.297731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aa292-30d5-4188-89de-09ed8599b87c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:17.303260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798946-e90c-4ca1-b9fa-f2be6f8640dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:17.303902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798946-e90c-4ca1-b9fa-f2be6f8640dc service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:17.304190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798946-e90c-4ca1-b9fa-f2be6f8640dc service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:17.304472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798946-e90c-4ca1-b9fa-f2be6f8640dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:17.312955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798946-e90c-4ca1-b9fa-f2be6f8640dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:17.314581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798946-e90c-4ca1-b9fa-f2be6f8640dc service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:17.324025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 762/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:21.318107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce779-4e4c-40d5-bab6-bddf9f0abb69 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:21.318729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce779-4e4c-40d5-bab6-bddf9f0abb69 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:21.318729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce779-4e4c-40d5-bab6-bddf9f0abb69 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:21.320112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:21.325940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876cfb4-cd09-4380-a7cb-c1c822afc733 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:21.326419 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876cfb4-cd09-4380-a7cb-c1c822afc733 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:21.326684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876cfb4-cd09-4380-a7cb-c1c822afc733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:21.346742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b876cfb4-cd09-4380-a7cb-c1c822afc733 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:21.347944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b876cfb4-cd09-4380-a7cb-c1c822afc733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:21.355848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:21.430689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ce779-4e4c-40d5-bab6-bddf9f0abb69 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:21.432592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eb9ce779-4e4c-40d5-bab6-bddf9f0abb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:21.512373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ce779-4e4c-40d5-bab6-bddf9f0abb69 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:21.516627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4d5f-2d5f-4282-8620-bd567de48f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:21.517271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4d5f-2d5f-4282-8620-bd567de48f26 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:21.517560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4d5f-2d5f-4282-8620-bd567de48f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:21.517841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4d5f-2d5f-4282-8620-bd567de48f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:21.526812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b4d5f-2d5f-4282-8620-bd567de48f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:21.528254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b4d5f-2d5f-4282-8620-bd567de48f26 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:21.537956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 767/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:23.569080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c4f9-502d-4178-b7f0-5aa54b7fdfaa None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:23.569687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c4f9-502d-4178-b7f0-5aa54b7fdfaa None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:23.569687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c4f9-502d-4178-b7f0-5aa54b7fdfaa None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:23.571068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:23.576973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4ea6-bde7-41a3-9d49-1755a7b2ead1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:23.577427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4ea6-bde7-41a3-9d49-1755a7b2ead1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:23.577537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4ea6-bde7-41a3-9d49-1755a7b2ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:23.595996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9d9c4ea6-bde7-41a3-9d49-1755a7b2ead1 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:23.597208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9d9c4ea6-bde7-41a3-9d49-1755a7b2ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:23.605234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:23.642130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c4f9-502d-4178-b7f0-5aa54b7fdfaa None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:23.652783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c4f9-502d-4178-b7f0-5aa54b7fdfaa None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:23.656932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89f78-c8b3-4ff5-a45c-880e2e301bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:23.657561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89f78-c8b3-4ff5-a45c-880e2e301bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:23.658099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89f78-c8b3-4ff5-a45c-880e2e301bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:23.658403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89f78-c8b3-4ff5-a45c-880e2e301bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:23.667224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d89f78-c8b3-4ff5-a45c-880e2e301bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:23.668654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d89f78-c8b3-4ff5-a45c-880e2e301bc4 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:23.678621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 765/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:27.269142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d959ee6-b5ee-4143-a442-7229742c1444 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:27.269714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d959ee6-b5ee-4143-a442-7229742c1444 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:27.269714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d959ee6-b5ee-4143-a442-7229742c1444 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:27.271127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:27.276447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b2c5-9aab-49eb-9ec3-de16ac77bb94 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:27.276896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b2c5-9aab-49eb-9ec3-de16ac77bb94 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:27.277006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b2c5-9aab-49eb-9ec3-de16ac77bb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:27.284442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=81 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:27.297289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a145b2c5-9aab-49eb-9ec3-de16ac77bb94 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:27.298536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a145b2c5-9aab-49eb-9ec3-de16ac77bb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:27.306374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:27.615751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d959ee6-b5ee-4143-a442-7229742c1444 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:27.617503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5d959ee6-b5ee-4143-a442-7229742c1444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:27.683360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:27.697286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d959ee6-b5ee-4143-a442-7229742c1444 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:27.701206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83556bbe-7ce6-4b27-93d2-4ecf3ca66285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:27.701856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83556bbe-7ce6-4b27-93d2-4ecf3ca66285 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:27.702147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83556bbe-7ce6-4b27-93d2-4ecf3ca66285 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:27.702465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83556bbe-7ce6-4b27-93d2-4ecf3ca66285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:27.711690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83556bbe-7ce6-4b27-93d2-4ecf3ca66285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:27.713117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83556bbe-7ce6-4b27-93d2-4ecf3ca66285 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:27.723068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 770/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:29.795209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc4117-5084-4814-8c14-0defe3cb8bf7 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:29.795768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc4117-5084-4814-8c14-0defe3cb8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:29.795768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc4117-5084-4814-8c14-0defe3cb8bf7 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:29.797152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:43:29.802417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35516-84a8-4272-ab75-b797569d7245 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:29.802857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35516-84a8-4272-ab75-b797569d7245 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:29.802990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35516-84a8-4272-ab75-b797569d7245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:29.821116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-01e35516-84a8-4272-ab75-b797569d7245 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:29.822324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-01e35516-84a8-4272-ab75-b797569d7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:29.830538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:30.136144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc4117-5084-4814-8c14-0defe3cb8bf7 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:30.138415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-97bc4117-5084-4814-8c14-0defe3cb8bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:30.152017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc4117-5084-4814-8c14-0defe3cb8bf7 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:30.157736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d240402-9797-4380-98d9-7c0fe47510ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:30.158683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240402-9797-4380-98d9-7c0fe47510ea service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:30.158966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240402-9797-4380-98d9-7c0fe47510ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:30.159243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240402-9797-4380-98d9-7c0fe47510ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:30.168562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240402-9797-4380-98d9-7c0fe47510ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:30.170070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240402-9797-4380-98d9-7c0fe47510ea service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:30.179677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 768/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:39.815826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=11 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:40.175426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=8 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:58.484092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.489293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.489293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.510012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:58.511440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:58.523295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 772/1540] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:58.532385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.533331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.533801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.558846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:58.560063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:58.579271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 769/1541] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:58.584085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:58.594989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7bb5-4fc8-476c-a520-046ef3c91292 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:58.605843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:58.606554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.606848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.607132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.607874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:44:58.608417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:58.610426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:58.627628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 773/1542] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:44:58.635655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:58.650625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317ec3-7de6-4a94-8de0-d482714f03d5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:58.659855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:58.660546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.660836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.661119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.661842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:58.663844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:58.732622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 770/1543] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:44:58 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:44:58.738128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:58.757662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba01c-503c-421b-900f-7a201022f90d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:58.846887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:58.847743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.848090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.848386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.849101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:58.855944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:58.898628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 774/1544] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:44:58 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:44:58.902417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:58.918134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ecffb-6216-492d-a7ea-688a43c9a442 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:58.926768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:58.927676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.927972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.928257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.929003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:58.932976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:58.945916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 771/1545] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:44:58.950042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:58.967958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d38d7-dd15-4e42-b437-89a129a0df71 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:58.977671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0cb4-34ab-4682-9ee0-4606c5184d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:58.978394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0cb4-34ab-4682-9ee0-4606c5184d4b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:58.978742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0cb4-34ab-4682-9ee0-4606c5184d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:58.979032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0cb4-34ab-4682-9ee0-4606c5184d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:58.979831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0cb4-34ab-4682-9ee0-4606c5184d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:58.981527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0cb4-34ab-4682-9ee0-4606c5184d4b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:58.995040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 775/1546] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:44:58.999903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.017834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b44f4-9dfd-4472-88f8-46397b007e86 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.026644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676aad7-c08f-4093-a847-05c716bfe85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.027941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676aad7-c08f-4093-a847-05c716bfe85c admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.028469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676aad7-c08f-4093-a847-05c716bfe85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.029003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676aad7-c08f-4093-a847-05c716bfe85c admin admin] PATH_INFO: `/v3/projects/171a2f5462994c8d98ffd8cbc2ce5677/users/fca86639f2d344be97cb1529dc17f62a/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.052137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76c35-3254-4a29-8267-d683cd2c5055 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.052491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76c35-3254-4a29-8267-d683cd2c5055 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.052721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76c35-3254-4a29-8267-d683cd2c5055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.055929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676aad7-c08f-4093-a847-05c716bfe85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=171a2f5462994c8d98ffd8cbc2ce5677, user_id=fca86639f2d344be97cb1529dc17f62a, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.059224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676aad7-c08f-4093-a847-05c716bfe85c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.082456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a5b76c35-3254-4a29-8267-d683cd2c5055 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.088023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a5b76c35-3254-4a29-8267-d683cd2c5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.090700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 772/1547] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:44:58 2022] PUT /identity/v3/projects/171a2f5462994c8d98ffd8cbc2ce5677/users/fca86639f2d344be97cb1529dc17f62a/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:44:59.096095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.096761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.097304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.129727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.131405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.203856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 776/1548] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.212804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.213128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.213376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.242964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 773/1549] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:44:59.265579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.267345 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.268404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.274382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.285905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 777/1550] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:44:59.294387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.303552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b3e50-4ee5-458f-97d1-d41a58acade8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.314451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.314451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.314451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.314451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.314951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:44:59.314951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.316278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022e53-649a-415f-ba04-5f3f23c20454 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.339126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 778/1551] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:44:59.341121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.341121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.341406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.367446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498490-f71f-45d9-b857-88e2c938bcb7 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.373661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.376249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.378738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93b9fa-da8d-4b85-b926-82d283c6b381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.379602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b9fa-da8d-4b85-b926-82d283c6b381 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.380046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b9fa-da8d-4b85-b926-82d283c6b381 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.380495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b9fa-da8d-4b85-b926-82d283c6b381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.396399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 779/1552] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.397389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.402676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b9fa-da8d-4b85-b926-82d283c6b381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.409523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b9fa-da8d-4b85-b926-82d283c6b381 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.415013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176b1c-9390-4173-bd1c-93accfb1cd4d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.428545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 774/1553] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:59.429613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.430279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612290e9-1d9c-4a5c-83cb-3cc894591d0f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.430520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.430921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.431118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612290e9-1d9c-4a5c-83cb-3cc894591d0f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.431387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.431733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612290e9-1d9c-4a5c-83cb-3cc894591d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.432315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.433445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:44:59.433445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:44:59.433445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:44:59.442451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bda28-12d2-415f-aa6b-70e20537fd43 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.480047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-612290e9-1d9c-4a5c-83cb-3cc894591d0f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.481421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-612290e9-1d9c-4a5c-83cb-3cc894591d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.506856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 780/1554] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:44:59.508103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.509133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.518388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.518604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 775/1555] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.518604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7659d0-4555-4335-8bf5-67bfdbb79d34 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.518604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7659d0-4555-4335-8bf5-67bfdbb79d34 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.518604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7659d0-4555-4335-8bf5-67bfdbb79d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.555913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.555913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.560940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3a7659d0-4555-4335-8bf5-67bfdbb79d34 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.562039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:59.565282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3a7659d0-4555-4335-8bf5-67bfdbb79d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.592619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:59.623506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 781/1556] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.626418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.634599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbcc93-5234-4013-987a-2bb6a1b71a35 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.640612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a5ee8-a742-40ad-b847-9020fa33b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.641575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5ee8-a742-40ad-b847-9020fa33b1fd admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.641935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5ee8-a742-40ad-b847-9020fa33b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.642260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5ee8-a742-40ad-b847-9020fa33b1fd admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.643046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a5ee8-a742-40ad-b847-9020fa33b1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.645023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a5ee8-a742-40ad-b847-9020fa33b1fd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.658383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 776/1557] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.658383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e98af-1988-4c82-a046-2863c0ae3bae None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.658383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e98af-1988-4c82-a046-2863c0ae3bae None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.658383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e98af-1988-4c82-a046-2863c0ae3bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.672763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 782/1558] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:44:59.673446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfd95-f0ba-4224-b6cb-5acee8c4722a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.673793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfd95-f0ba-4224-b6cb-5acee8c4722a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.674082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfd95-f0ba-4224-b6cb-5acee8c4722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.684838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a58e98af-1988-4c82-a046-2863c0ae3bae None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.689362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a58e98af-1988-4c82-a046-2863c0ae3bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.704275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b77cfd95-f0ba-4224-b6cb-5acee8c4722a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.705845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b77cfd95-f0ba-4224-b6cb-5acee8c4722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.711082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 777/1559] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.712495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.712797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.713082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.719083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 783/1560] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.720278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b263-fa48-4bdf-8026-4ba7df1b4c28 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.720574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b263-fa48-4bdf-8026-4ba7df1b4c28 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.720856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b263-fa48-4bdf-8026-4ba7df1b4c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.736796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.738083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.742594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cd49b263-fa48-4bdf-8026-4ba7df1b4c28 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.744299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cd49b263-fa48-4bdf-8026-4ba7df1b4c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.746867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 778/1561] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.755080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 784/1562] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.755948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.756916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.757255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.757641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.769000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd56e5-2feb-42c3-baea-2d660cf47942 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.774244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.774959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.775234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.775504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.776232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:44:59.776542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.777682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:44:59.777682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:44:59.777682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:44:59.778656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.780065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.782111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.791368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 785/1563] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.793058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 779/1564] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:44:59.793890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.795682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.806242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7de61a-03ac-45db-8f57-8df6093bd40a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.806426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210845-1e59-4ad5-9e2c-121727621184 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.811045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.811766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70c27-92e8-4613-8fd7-81a214277c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.811933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.812263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.812541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.812865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70c27-92e8-4613-8fd7-81a214277c67 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.813247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70c27-92e8-4613-8fd7-81a214277c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.813622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70c27-92e8-4613-8fd7-81a214277c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.813890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:44:59.814208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.814763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70c27-92e8-4613-8fd7-81a214277c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.816063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb26e-747e-45f6-9e92-b335ee1c6913 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.816696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70c27-92e8-4613-8fd7-81a214277c67 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.838583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 780/1565] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:44:59.838583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2f9dd-7123-40ee-a73b-b30caca98270 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.838583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2f9dd-7123-40ee-a73b-b30caca98270 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.838583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2f9dd-7123-40ee-a73b-b30caca98270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.839089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 786/1566] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:44:59.839089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.839089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.839353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.871815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.872992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3ec2f9dd-7123-40ee-a73b-b30caca98270 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.873623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.874603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3ec2f9dd-7123-40ee-a73b-b30caca98270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.884614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 781/1567] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.888578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.888768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 787/1568] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.888870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.888870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.889035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.902747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b900b-5d38-4e2f-9d8f-3baa8906c173 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.909768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:59.910792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:59.912439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.913886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.914860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.915445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.917171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:44:59.917735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.919506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 782/1569] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:59.923746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.925133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.936108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ab167-6c84-46fb-a63a-9cae8bb9be3c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.939492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 788/1570] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:44:59.942215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.943209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.943793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.944396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.945411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.947863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.948359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.960930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d11b0-7950-429b-a188-0f9df743ecf1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:59.968841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:59.970343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:59.970671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:59.970929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:59.971715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:59.973406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:59.985151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 783/1571] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:44:59.986446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:59.990791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 789/1572] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:44:59.991889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.006092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa395-2ec2-455d-9fda-0b7446a6d211 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.068092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdd49d-663d-4aa8-803f-5d46f923b965 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.073802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.074573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.074876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.075159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.075871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.078086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.078223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.079025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.079317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.079602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.080342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:00.080656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.082486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.095320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 790/1573] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:00.096608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.110198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4b50-106e-4daf-a9e5-06bfe8443ab6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.112661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 784/1574] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:44:59 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.113511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.142722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:00.161612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:00.182373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.183105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.183402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.183689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.184461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:00.184778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.186508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.189094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f3e73-ed29-4bd4-838e-61dabfef16ef admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.196270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.196270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.196488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.196592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.197446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:00.197760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.200010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.200139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 791/1575] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:00.200957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.211701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d9d8f-168b-404e-8877-ce5e4a7802e6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.216950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.217804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.219022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.219501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.220367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.222479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.223512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 785/1576] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:00.224521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.237555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf39be-b009-4e77-ba2f-27c9c8b5839e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.244349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.245219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.245536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.245753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.246503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.247733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:45:00.247733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:45:00.247733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:45:00.249772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.259997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 792/1577] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.261334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.281250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 786/1578] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/users => generated 303 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.281250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.299934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402345d-6a3f-4fec-a178-e14c73c6034e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.356255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7a4d-9e83-4b6a-aef1-cff0248b7b23 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.362164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.363436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.363859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.364050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] PATH_INFO: `/v3/projects/45a72d232f314a78b0e1c3f04b0ed682/users/2d7c42cf0bc84292bb0b7edb9f2e7fc3/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.385344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.386456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.386748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.387027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.387784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.388059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a72d232f314a78b0e1c3f04b0ed682, user_id=2d7c42cf0bc84292bb0b7edb9f2e7fc3, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.389190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:45:00.389190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:45:00.389190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:45:00.390494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.392236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.412091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 793/1579] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:00 2022] PUT /identity/v3/projects/45a72d232f314a78b0e1c3f04b0ed682/users/2d7c42cf0bc84292bb0b7edb9f2e7fc3/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:00.413797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.429943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 787/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.431436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.508440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c864-33c0-4fc7-a512-e1cc4d04085f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.510631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e254-1257-4fdc-88f3-1f545cccd95a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.513894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.515287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.515687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.516333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.517275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.519607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.519769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.520304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.520592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.521026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.521736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.525169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.558987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 788/1581] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.558987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.559299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 794/1582] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/users => generated 281 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.559299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.575808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7664828-7633-4c27-8547-27568c1a973a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.586752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:00.604213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:00.651922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.652765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.653159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.654026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.654349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.654998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7b13-1718-4ecb-8666-367f6b56cdb3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.657219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.661911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de92ada-1b54-40ac-8572-d3863517eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.662830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92ada-1b54-40ac-8572-d3863517eb94 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.663272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92ada-1b54-40ac-8572-d3863517eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.663779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92ada-1b54-40ac-8572-d3863517eb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.664642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de92ada-1b54-40ac-8572-d3863517eb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.666837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de92ada-1b54-40ac-8572-d3863517eb94 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.686560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 795/1583] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.688660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.702183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 789/1584] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.702183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.702183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.702183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.704170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776f2e-8b84-4e44-ad8a-d097990c9b47 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.720652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:00.721991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:00.786418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.787121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.787946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.788236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.788985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.793002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.809936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 796/1585] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:00.810965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.822286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 790/1586] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:00.823776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.826327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9975d-a00c-43b5-aecc-edffdc753df9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.832491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.833184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.833474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.833786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.834762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.837266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.849648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42801c9a-4a3b-4e49-9903-2fc2266d98cf None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.856803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.857550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.859176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.859584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.860870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.864219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.873822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 797/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/users => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.875562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.888692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 791/1588] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:00.888692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.905127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22156-b45d-46a8-bb5a-5c4c36b517c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.908523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf419-fa10-4591-b13a-8dd68211d5e2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.913382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.915184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.915476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.918090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.918090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.925062 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.926457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.926822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.927182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.927354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.928071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.930581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.947212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 792/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:00.948089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.956766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 798/1590] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/users => generated 294 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:00.957965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:00.965219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5e910-f134-459c-b11f-b253bc496d3e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.970019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6835a8-055f-4edd-a98a-890478dff6eb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:00.973489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.974752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.974910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:00.975023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.975391 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:00.975520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.975675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:00.975957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:00.976511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.976843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:00.978465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.978892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:00.991181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 799/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:00.992378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.017350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 793/1592] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:00 2022] POST /identity/v3/users => generated 290 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:01.018577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.031305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd821a-3027-4c2d-b5c0-7446b3c39fa7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.042823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.043692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.044088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.044445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.046323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.049366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.070344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281a3f-04b3-410f-bd7b-eca657c50a16 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.074381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 794/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.075536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.080212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.081211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.081786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.082230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.086921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2e52e-68bd-4546-88f6-46a4f4900610 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.089840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:01.092530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.094232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.094707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.095980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.096651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.097165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.098861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.099300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.116244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 800/1594] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:01.119145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.121302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 795/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.122433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.130415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8883dd-c7d3-46a9-b125-89d81f736968 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.138883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.139098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6bef-f50a-4211-866d-09af0226acdf admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.139268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.140976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.141340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.142142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.144949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.153785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.154545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.154839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.157543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.158326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.160926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 801/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.162062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.167392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.178701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870b695-a2c4-409d-a2a3-67560b91d8ca admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.188397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.189561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.189853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.190225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] PATH_INFO: `/v3/projects/f793d379eb404ca3ada5ac83fbb3bbdd/users/5b2c2da335fc4585972e0d9bb65bb1f4/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.199468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 796/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.200517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.212213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f793d379eb404ca3ada5ac83fbb3bbdd, user_id=5b2c2da335fc4585972e0d9bb65bb1f4, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.215193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.215639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c8b49-73d1-4cd5-80a1-cb000f7b7597 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.222424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.223087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.223381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.223664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.224816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.228381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.233304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 802/1598] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:01 2022] PUT /identity/v3/projects/f793d379eb404ca3ada5ac83fbb3bbdd/users/5b2c2da335fc4585972e0d9bb65bb1f4/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:01.235184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.250494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 797/1599] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.251425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.262923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68720a2-1f91-43c4-bd44-200685907062 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.295601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:01.337599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545422a7-c969-408d-a97f-2b62f09c6beb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.343988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.344783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.345204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.345495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.346243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.348071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.364267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 803/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.365222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.371615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.372732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.373384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.373661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] PATH_INFO: `/v3/projects/ad63f6ea40454c9081f5e817db60041d/users/d4803fb1cc444c3b8307143af3fe01d0/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.377336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031f5bd-15f4-4253-8685-67a40587488a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.384892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5609cb-da74-4a75-a834-4331cda2fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.385972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5609cb-da74-4a75-a834-4331cda2fe0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.386524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5609cb-da74-4a75-a834-4331cda2fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.386908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5609cb-da74-4a75-a834-4331cda2fe0c admin admin] PATH_INFO: `/v3/projects/e7b6c65434d94f59be68e2d66bbcff14/users/ffa73d657a3345368276bc55bd5fe1f9/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.395995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad63f6ea40454c9081f5e817db60041d, user_id=d4803fb1cc444c3b8307143af3fe01d0, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.399262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.410685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5609cb-da74-4a75-a834-4331cda2fe0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b6c65434d94f59be68e2d66bbcff14, user_id=ffa73d657a3345368276bc55bd5fe1f9, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.414112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5609cb-da74-4a75-a834-4331cda2fe0c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.422487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 798/1601] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:01 2022] PUT /identity/v3/projects/ad63f6ea40454c9081f5e817db60041d/users/d4803fb1cc444c3b8307143af3fe01d0/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:01.424022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.452788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 804/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:01 2022] PUT /identity/v3/projects/e7b6c65434d94f59be68e2d66bbcff14/users/ffa73d657a3345368276bc55bd5fe1f9/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:01.454746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.455146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.455531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.524235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] MFA Rules not processed for user `5b2c2da335fc4585972e0d9bb65bb1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:01.524235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:01.595238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0233403-08d0-4602-a042-56542c9b44b3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.662320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 805/1603] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:01.667844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.706176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.707117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.707407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.707688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.708606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.710245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.711077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:01.723295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 799/1604] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.723959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:01.737047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54c1e-6df9-4211-b1ea-e76079ddb8b7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.745707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce632715-b8e9-4e05-91c8-d17bc03610ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.746848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce632715-b8e9-4e05-91c8-d17bc03610ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.747002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce632715-b8e9-4e05-91c8-d17bc03610ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.747446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce632715-b8e9-4e05-91c8-d17bc03610ba admin admin] PATH_INFO: `/v3/projects/3904cb8d017b47c7afb8a73ee7a4807a/users/9800f036e5b14f569b5edfc12ff3d7fd/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.773674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce632715-b8e9-4e05-91c8-d17bc03610ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3904cb8d017b47c7afb8a73ee7a4807a, user_id=9800f036e5b14f569b5edfc12ff3d7fd, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.777015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce632715-b8e9-4e05-91c8-d17bc03610ba admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.805638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70faf-34bb-4e6c-a99e-e330b20a1e00 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:01.818404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 800/1605] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:01 2022] PUT /identity/v3/projects/3904cb8d017b47c7afb8a73ee7a4807a/users/9800f036e5b14f569b5edfc12ff3d7fd/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:01.818404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.818404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.818404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.860416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] MFA Rules not processed for user `d4803fb1cc444c3b8307143af3fe01d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:01.861800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:01.878230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:01.881335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bbe71-9175-4934-9943-c4240cac7093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:01.882133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bbe71-9175-4934-9943-c4240cac7093 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.882671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bbe71-9175-4934-9943-c4240cac7093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.883297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bbe71-9175-4934-9943-c4240cac7093 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.884645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bbe71-9175-4934-9943-c4240cac7093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:01.886400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bbe71-9175-4934-9943-c4240cac7093 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:01.898448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 806/1606] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:01.900410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:01.900877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:01.901282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:01.935401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] MFA Rules not processed for user `ffa73d657a3345368276bc55bd5fe1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:01.937363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:01.979734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 801/1607] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:01.981883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.004302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72296a-cdd6-461b-b196-13ce5b6abb6e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.014132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0429a9-697e-42e5-bdcb-37429f5cfdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.015726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0429a9-697e-42e5-bdcb-37429f5cfdca admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.016220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0429a9-697e-42e5-bdcb-37429f5cfdca admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.017329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0429a9-697e-42e5-bdcb-37429f5cfdca admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.018232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0429a9-697e-42e5-bdcb-37429f5cfdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.020648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0429a9-697e-42e5-bdcb-37429f5cfdca admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.036304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 807/1608] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:02.037600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.053122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88795-df0d-4f8a-b310-401e12c58923 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.061769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.063029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.063471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.063811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] PATH_INFO: `/v3/projects/a872b4eafae74b82896bd09229152104/users/4785719411fd4af892868d99fca7cd71/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.075560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 802/1609] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:01 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:02.087957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.089049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.089506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.091313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a872b4eafae74b82896bd09229152104, user_id=4785719411fd4af892868d99fca7cd71, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.095027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.135300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 808/1610] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:02 2022] PUT /identity/v3/projects/a872b4eafae74b82896bd09229152104/users/4785719411fd4af892868d99fca7cd71/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:02.136427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.141961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] MFA Rules not processed for user `9800f036e5b14f569b5edfc12ff3d7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:02.143297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:02.190705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.270241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 803/1611] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:02.271448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.284667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3e95-714e-4beb-8aac-77e9e67c4454 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.290876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.291886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.292440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.292440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] PATH_INFO: `/v3/projects/905aecc2e33f4befb1a47740e8d53611/users/831d1557afd649518d34d4f970f96674/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.314429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905aecc2e33f4befb1a47740e8d53611, user_id=831d1557afd649518d34d4f970f96674, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.318572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.346636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 809/1612] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:02 2022] PUT /identity/v3/projects/905aecc2e33f4befb1a47740e8d53611/users/831d1557afd649518d34d4f970f96674/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:02.347640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.405933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b1f22-46d6-43e2-85c4-db5ea470fa1d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.428589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ecd6c-3937-4f71-955f-6fb0794bb442 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.433612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.434272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.434583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.434863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.443747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.487510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43d50-35c8-42cb-b11e-c9b0de85df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.488195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43d50-35c8-42cb-b11e-c9b0de85df92 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.489056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43d50-35c8-42cb-b11e-c9b0de85df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.489342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43d50-35c8-42cb-b11e-c9b0de85df92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.490099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43d50-35c8-42cb-b11e-c9b0de85df92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.493113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43d50-35c8-42cb-b11e-c9b0de85df92 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.513403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.517651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.529696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 810/1613] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:02.531266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 804/1614] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:02.532442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.533960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa6a5-9c5c-4ef4-b520-f752d51f8cca None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.535261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa6a5-9c5c-4ef4-b520-f752d51f8cca None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.536579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa6a5-9c5c-4ef4-b520-f752d51f8cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.550995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4bad9-895b-4488-8135-b5da07edfada service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.556647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7defa6a5-9c5c-4ef4-b520-f752d51f8cca None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:02.558027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7defa6a5-9c5c-4ef4-b520-f752d51f8cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:02.636070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.637495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.638140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.638548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.639349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.641411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.647064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 805/1615] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:02.648343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cee82-16ea-4245-ad7e-74ce80f074cd None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.648644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cee82-16ea-4245-ad7e-74ce80f074cd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.648928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cee82-16ea-4245-ad7e-74ce80f074cd None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.655484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 806/1616] 10.222.0.64 () {54 vars in 962 bytes} [Tue Jul 19 15:45:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:02.657439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18bf91-4785-4cb9-a427-861fd33f638e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.657804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18bf91-4785-4cb9-a427-861fd33f638e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.658104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18bf91-4785-4cb9-a427-861fd33f638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.663485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.690592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 811/1617] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:02.691133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-eb18bf91-4785-4cb9-a427-861fd33f638e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:02.691750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.692601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-eb18bf91-4785-4cb9-a427-861fd33f638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:02.701409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 807/1618] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:02.703542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.703997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.704283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.722343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae284-db1e-48e3-8d1d-b46b78223383 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.732332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.733320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.734374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.735048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.735936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.739054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.748953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:02.750433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:02.775867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 812/1619] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/users => generated 289 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:02.777409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.901912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d368-06d7-4568-83af-85e601d27770 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.907369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.908198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.908430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.908711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.909033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 808/1620] 10.222.0.64 () {58 vars in 1059 bytes} [Tue Jul 19 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:02.914627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.919939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.923413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.937177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080621a4-1bec-4b9f-9cb1-ef613ac2deb9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.938714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 813/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:02.939644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.945904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.946743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.947137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.947523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.948379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.949754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa647d6-b380-4921-b143-fec8692936dd service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.950344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:02.956991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:02.957999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:02.958523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:02.958969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:02.970412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 809/1622] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:02.970412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:02.989742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:02.991494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b697-a9f3-4a5c-b8fe-54bee17c487f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:02.991880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.001267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.001963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.002341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.002659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.003426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.013180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.020557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 814/1623] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:03.021306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.041574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 810/1624] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:03.041574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.050714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5b1ae-285b-4084-bbf7-084a97fa9d9f service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.058700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.059719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.060087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c242b-4678-4b6d-bbd5-b571bb18c4cf admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.060485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.061038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.078430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.079366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.079651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.079944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] PATH_INFO: `/v3/projects/04ddfb22036243cd975f03631292823f/users/2443d09e2bfb4d869941c4ed4475546a/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.095589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:03.115632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ddfb22036243cd975f03631292823f, user_id=2443d09e2bfb4d869941c4ed4475546a, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.118800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.169608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 811/1625] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:03 2022] PUT /identity/v3/projects/04ddfb22036243cd975f03631292823f/users/2443d09e2bfb4d869941c4ed4475546a/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:03.171348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.200071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.203233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.230989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 815/1626] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:03.232144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.263817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c8cdd-df6d-488f-83a1-842a544d1f8d service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.382402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4447-a6ec-4203-9aa5-a3248b3bf469 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.394755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.395824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.396239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.396632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] PATH_INFO: `/v3/projects/ef3360b2c9284de891207a1f5a61ad9b/users/c2fb262af1bb46e4b62811c7fc977ab0/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.419163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.420240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.420685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.423869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.427457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.429065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3360b2c9284de891207a1f5a61ad9b, user_id=c2fb262af1bb46e4b62811c7fc977ab0, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.429783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.435641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.460161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 816/1627] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:03.462459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.472537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 812/1628] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:03 2022] PUT /identity/v3/projects/ef3360b2c9284de891207a1f5a61ad9b/users/c2fb262af1bb46e4b62811c7fc977ab0/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:03.476763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.477034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:03.489520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c658-4672-4282-9068-25fb8fb26a4c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.610943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458a19f-17fd-4d17-a349-e368d09c6323 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.622248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91757b0-eb21-4136-9932-8484fabfac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.623213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91757b0-eb21-4136-9932-8484fabfac78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.623498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91757b0-eb21-4136-9932-8484fabfac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.623785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91757b0-eb21-4136-9932-8484fabfac78 admin admin] PATH_INFO: `/v3/projects/04ddfb22036243cd975f03631292823f/users/2443d09e2bfb4d869941c4ed4475546a/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.627238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.628223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.628514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.628871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.629363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91757b0-eb21-4136-9932-8484fabfac78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ddfb22036243cd975f03631292823f, user_id=2443d09e2bfb4d869941c4ed4475546a, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.629764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.631473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.634895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91757b0-eb21-4136-9932-8484fabfac78 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.666513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 813/1629] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:03.671518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:03.690938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ff3e-ebd6-426d-a6a5-60f5761551c5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:03.708860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 817/1630] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:03 2022] PUT /identity/v3/projects/04ddfb22036243cd975f03631292823f/users/2443d09e2bfb4d869941c4ed4475546a/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:03.710476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.714960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.715250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.794910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45419121-3764-4eea-bd9c-30e62cea3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:03.796224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45419121-3764-4eea-bd9c-30e62cea3727 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.796687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45419121-3764-4eea-bd9c-30e62cea3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.797193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45419121-3764-4eea-bd9c-30e62cea3727 admin admin] PATH_INFO: `/v3/projects/ef3360b2c9284de891207a1f5a61ad9b/users/c2fb262af1bb46e4b62811c7fc977ab0/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.801501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45419121-3764-4eea-bd9c-30e62cea3727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3360b2c9284de891207a1f5a61ad9b, user_id=c2fb262af1bb46e4b62811c7fc977ab0, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:03.809120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45419121-3764-4eea-bd9c-30e62cea3727 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:03.828088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:03.857295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] MFA Rules not processed for user `2443d09e2bfb4d869941c4ed4475546a`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:03.858385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:03.869826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 814/1631] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:03 2022] PUT /identity/v3/projects/ef3360b2c9284de891207a1f5a61ad9b/users/c2fb262af1bb46e4b62811c7fc977ab0/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:03.875606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:03.877468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:03.877981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:03.953473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] MFA Rules not processed for user `c2fb262af1bb46e4b62811c7fc977ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:03.954852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:04.036959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 818/1632] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:04.045152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:04.133347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 815/1633] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:04.134383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5184ea5-168f-4598-b050-86e4957c65df None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:04.139620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:04.141313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.141708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.142098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.144245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:04.162430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:04.162576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9d8c9-f101-49df-8e9f-ac009164790d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:04.166450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:04.172928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:04.173613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.173909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.174193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.179510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 819/1634] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:04.215833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:04.220074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:04.259030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 816/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:04.481855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:04.495429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:04.506457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d7f79-6629-4028-a1ad-c2cc8e4e0f93 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:04.522713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03691-b205-4a79-a729-e7e14fd93ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:04.524209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03691-b205-4a79-a729-e7e14fd93ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.525686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03691-b205-4a79-a729-e7e14fd93ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.526027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03691-b205-4a79-a729-e7e14fd93ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.561105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:04.641496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ae96-9f74-4142-bd08-29f1bcea3949 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:04.653661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:04.654606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.654898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.655177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] PATH_INFO: `/v3/users/5b2c2da335fc4585972e0d9bb65bb1f4` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.660681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2c2da335fc4585972e0d9bb65bb1f4)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:04.661745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:45:04.661745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 19 15:45:04.661745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: Jul 19 15:45:04.663070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:04.682672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03691-b205-4a79-a729-e7e14fd93ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:04.683651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03691-b205-4a79-a729-e7e14fd93ae9 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:04.704833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 817/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:04.707116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e4fc-5da8-413a-a22a-b860abc249bc None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.707409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e4fc-5da8-413a-a22a-b860abc249bc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.707690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e4fc-5da8-413a-a22a-b860abc249bc None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.709268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 818/1637] 10.222.0.64 () {54 vars in 962 bytes} [Tue Jul 19 15:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:04.716501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1c4ee-9aa7-4575-ae91-0842df216c08 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.716956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1c4ee-9aa7-4575-ae91-0842df216c08 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.717246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1c4ee-9aa7-4575-ae91-0842df216c08 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.725632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 819/1638] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 19 15:45:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:04.729581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063039-a417-4473-8942-d99eafaed7ef None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.729581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063039-a417-4473-8942-d99eafaed7ef None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.729892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063039-a417-4473-8942-d99eafaed7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.766074 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7d063039-a417-4473-8942-d99eafaed7ef None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:04.768205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7d063039-a417-4473-8942-d99eafaed7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:04.806956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2c2da335fc4585972e0d9bb65bb1f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:04.865356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2c2da335fc4585972e0d9bb65bb1f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:04.866272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2c2da335fc4585972e0d9bb65bb1f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:04.867077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2c2da335fc4585972e0d9bb65bb1f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:04.894405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-13980720-55cb-4d00-8ceb-9261ff70d40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2c2da335fc4585972e0d9bb65bb1f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:04.917890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 820/1639] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:04 2022] DELETE /identity/v3/users/5b2c2da335fc4585972e0d9bb65bb1f4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:04.917890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d61e0-ded8-424c-979d-e41ad4f0733a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:04.917890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d61e0-ded8-424c-979d-e41ad4f0733a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:04.917890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d61e0-ded8-424c-979d-e41ad4f0733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:04.977569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5d1d61e0-ded8-424c-979d-e41ad4f0733a None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:04.978699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5d1d61e0-ded8-424c-979d-e41ad4f0733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.009507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:05.055477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 820/1640] 10.222.0.64 () {58 vars in 1059 bytes} [Tue Jul 19 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:05.070198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.070198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.070198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.163314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 821/1641] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:05.164988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939e2e6-ea91-4ccd-b05b-a0d66b583cff None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.165298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939e2e6-ea91-4ccd-b05b-a0d66b583cff None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.165586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939e2e6-ea91-4ccd-b05b-a0d66b583cff None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.170486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 822/1642] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 19 15:45:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:05.177055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.177282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.177618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.189476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:05.206812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.234580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:05.236041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.265947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 823/1643] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:05.266860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:05.272429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.359546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:05.370627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 821/1644] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:05.372339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:05.374754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.427668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d3c4-c183-48fe-b83e-ed7b5882a956 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:05.437529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:05.438211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.438533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.438819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.462787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:05.464253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:05.475088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691befa-3aaa-41cc-8974-2a4a0e21af38 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:05.503493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:05.505105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.505561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.506050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.522566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:05.525900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:05.551155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 824/1645] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:05.552147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:05.555380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.573139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 822/1646] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:05.740091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de4d9f-5871-44f3-be33-566088803f4e service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:05.753631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6472ab-c6f5-4fed-9fd1-d66ca3d7ea43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:05.756882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6472ab-c6f5-4fed-9fd1-d66ca3d7ea43 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.756882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6472ab-c6f5-4fed-9fd1-d66ca3d7ea43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.756882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6472ab-c6f5-4fed-9fd1-d66ca3d7ea43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.809291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6472ab-c6f5-4fed-9fd1-d66ca3d7ea43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:05.809291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6472ab-c6f5-4fed-9fd1-d66ca3d7ea43 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:05.847428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 825/1647] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:05.850227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:05.852403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:05.877862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6afd6-29c0-4d09-bd7d-74b59ff056e4 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:05.903437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:05.906129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:05.908326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:05.908698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] PATH_INFO: `/v3/users/9800f036e5b14f569b5edfc12ff3d7fd` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:05.913570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9800f036e5b14f569b5edfc12ff3d7fd)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:05.915651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:06.060494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9800f036e5b14f569b5edfc12ff3d7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:06.062576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9800f036e5b14f569b5edfc12ff3d7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:06.072380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9800f036e5b14f569b5edfc12ff3d7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:06.073148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9800f036e5b14f569b5edfc12ff3d7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:06.084627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9800f036e5b14f569b5edfc12ff3d7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:06.114607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 823/1648] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:05 2022] DELETE /identity/v3/users/9800f036e5b14f569b5edfc12ff3d7fd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:06.117366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:06.117706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:06.117975 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:06.150118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:06.151517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:06.353758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 826/1649] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:06.519753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:06.521517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:06.568311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:06.746627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783eab7-7f46-42f0-8d24-2bb0856b08aa admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:06.775124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:06.775960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:06.777922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:06.779484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:06.818516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:06.822176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:06.864787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 824/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:07.456002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:07.457934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:07.479981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738fc0c-2764-495c-b0ad-68e4214659ff None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:07.490070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:07.493005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:07.493302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:07.493592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] PATH_INFO: `/v3/projects/f793d379eb404ca3ada5ac83fbb3bbdd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:07.496102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f793d379eb404ca3ada5ac83fbb3bbdd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:07.502662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:07.591791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f793d379eb404ca3ada5ac83fbb3bbdd', 'request_id': 'req-0cc6bb9d-de25-41d4-807c-89f2970fabb4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:07.607631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f793d379eb404ca3ada5ac83fbb3bbdd', 'request_id': 'req-0cc6bb9d-de25-41d4-807c-89f2970fabb4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:07.616432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f793d379eb404ca3ada5ac83fbb3bbdd', 'request_id': 'req-0cc6bb9d-de25-41d4-807c-89f2970fabb4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:07.643239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:07.649336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] The token cache is being invalidate because project f793d379eb404ca3ada5ac83fbb3bbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:07.651128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:07.652018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:07.654036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 827/1651] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:07 2022] DELETE /identity/v3/projects/f793d379eb404ca3ada5ac83fbb3bbdd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:07.659543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:07.709304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e921-7b0f-4f47-ae96-d73f1d96f797 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:07.884405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:07.885307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:07.885599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:07.885881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] PATH_INFO: `/v3/users/2443d09e2bfb4d869941c4ed4475546a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:07.887947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2443d09e2bfb4d869941c4ed4475546a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:07.892765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:08.045716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2443d09e2bfb4d869941c4ed4475546a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:08.051786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2443d09e2bfb4d869941c4ed4475546a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:08.082878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2443d09e2bfb4d869941c4ed4475546a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:08.086938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2443d09e2bfb4d869941c4ed4475546a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:08.112149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-33eb8bd3-b33d-487c-9a53-5e3f483c0f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2443d09e2bfb4d869941c4ed4475546a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:08.182618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 825/1652] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:07 2022] DELETE /identity/v3/users/2443d09e2bfb4d869941c4ed4475546a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:09.596605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:09.598645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:09.612817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6bb9d-de25-41d4-807c-89f2970fabb4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:09.681938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:09.686884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:09.687455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:09.687884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] PATH_INFO: `/v3/projects/3904cb8d017b47c7afb8a73ee7a4807a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:09.689410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3904cb8d017b47c7afb8a73ee7a4807a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:09.691615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:09.753353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3904cb8d017b47c7afb8a73ee7a4807a', 'request_id': 'req-54ded547-6954-4e91-896e-f83121c5f5b7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:09.763905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3904cb8d017b47c7afb8a73ee7a4807a', 'request_id': 'req-54ded547-6954-4e91-896e-f83121c5f5b7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:09.771922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3904cb8d017b47c7afb8a73ee7a4807a', 'request_id': 'req-54ded547-6954-4e91-896e-f83121c5f5b7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:09.798834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] The token cache is being invalidate because project 3904cb8d017b47c7afb8a73ee7a4807a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:09.799911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:09.808212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:09.815814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 828/1653] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:09 2022] DELETE /identity/v3/projects/3904cb8d017b47c7afb8a73ee7a4807a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:09.816651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68815-017a-4a32-b41c-9094523cfd29 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:09.817154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68815-017a-4a32-b41c-9094523cfd29 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:09.817578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68815-017a-4a32-b41c-9094523cfd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:09.863637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b0d68815-017a-4a32-b41c-9094523cfd29 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:09.865004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b0d68815-017a-4a32-b41c-9094523cfd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:09.933417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:09.940020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:09.993019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:10.111171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 826/1654] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:10.113747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.114043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.114330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.148366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded547-6954-4e91-896e-f83121c5f5b7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.153272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.154313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.154453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.154699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] PATH_INFO: `/v3/projects/04ddfb22036243cd975f03631292823f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.156394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ddfb22036243cd975f03631292823f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.161357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.213690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:10.218049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:10.257603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:10.259662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 827/1655] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:10.265958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.291435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809a0c1-d8a6-4477-9734-c7d5a5981308 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.302762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ddfb22036243cd975f03631292823f', 'request_id': 'req-d7732a9d-a1ee-49ec-af6a-a012954b9b44'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:10.317408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ddfb22036243cd975f03631292823f', 'request_id': 'req-d7732a9d-a1ee-49ec-af6a-a012954b9b44'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:10.338832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ddfb22036243cd975f03631292823f', 'request_id': 'req-d7732a9d-a1ee-49ec-af6a-a012954b9b44'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:10.369362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] The token cache is being invalidate because project 04ddfb22036243cd975f03631292823f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:10.369667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:10.370450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7732a9d-a1ee-49ec-af6a-a012954b9b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:10.373540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 829/1656] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:09 2022] DELETE /identity/v3/projects/04ddfb22036243cd975f03631292823f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:10.385547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139893c-ed55-4e39-a8be-a04bd6982d30 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.386285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139893c-ed55-4e39-a8be-a04bd6982d30 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.386811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139893c-ed55-4e39-a8be-a04bd6982d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.447209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c139893c-ed55-4e39-a8be-a04bd6982d30 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:10.448414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.449090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.449387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.449675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.451617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:10.451944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.455079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.458259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c139893c-ed55-4e39-a8be-a04bd6982d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:10.473944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 828/1657] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:10.475415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.477167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:10.492566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 830/1658] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:10.494524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.495290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.495290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.497639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818e11-5733-4fe0-938f-75895377f6ae admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.504445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.505619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.506695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.506986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.507957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.511962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.528606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:10.530716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:10.554173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 831/1659] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:10.555416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.575001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb02c-dda5-4f54-9cc4-3148ccdf7cef None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.581900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 829/1660] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:10.595026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.756526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.757210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.757494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.758224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.762857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:10.763148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.768380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.782815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834025-6eb6-47c3-b92d-8d5b55bd15d3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.803430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 832/1661] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:10.804379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.806527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.807222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.807504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.807781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.808488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.814949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.836128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322b45-9c9e-43ee-a315-c80acfc1d307 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.850269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.851038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.851405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.852019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.852723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.855686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.873784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 830/1662] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/users => generated 285 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:10.875883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.899833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533b72-b41d-4347-8bd2-776addc32507 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:10.912125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:10.913162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:10.914481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:10.914833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:10.915628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:10.918683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:10.942146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 833/1663] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:10.943157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.958494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 831/1664] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:10.959441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:10.989204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1283d46-3f23-4d19-b918-d503e50f943c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.047857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:11.072734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238e9b-8557-402e-89b5-ffff18c393c3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.086401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.087087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.087370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.087648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.091366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.098133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.148826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 834/1665] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:10 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:11.149873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:11.159880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.160579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.160870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.161150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.161896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.166138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.169964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9648ae-b238-4789-beb7-8a50306f83d0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.185205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae9520-2b17-411b-bbdd-7c42007dbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.185932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9520-2b17-411b-bbdd-7c42007dbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.186243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9520-2b17-411b-bbdd-7c42007dbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.188380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9520-2b17-411b-bbdd-7c42007dbab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.190733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9520-2b17-411b-bbdd-7c42007dbab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.193804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 832/1666] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:11.195924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9520-2b17-411b-bbdd-7c42007dbab1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.198916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:11.200626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:11.224835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a32b1-dc03-4f1e-96d5-a5d888103f80 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.230691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 835/1667] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:11.232842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787beb22-a614-419c-8639-da1b3cb134f4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.233809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787beb22-a614-419c-8639-da1b3cb134f4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.234525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787beb22-a614-419c-8639-da1b3cb134f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.239817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.240728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.241011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.241281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] PATH_INFO: `/v3/projects/f57965a6d2b343c49581d396631c913e/users/40bf380725314c509aa4b7d230e4c1b4/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.281800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57965a6d2b343c49581d396631c913e, user_id=40bf380725314c509aa4b7d230e4c1b4, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.292110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.300027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-787beb22-a614-419c-8639-da1b3cb134f4 None None] MFA Rules not processed for user `fca86639f2d344be97cb1529dc17f62a`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:11.301495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-787beb22-a614-419c-8639-da1b3cb134f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:11.328083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 833/1668] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:11 2022] PUT /identity/v3/projects/f57965a6d2b343c49581d396631c913e/users/40bf380725314c509aa4b7d230e4c1b4/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:11.328083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:11.480339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3926-ca84-466b-9b8e-5924c5963871 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.493953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.494673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.494960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.495235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.495973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.497737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.525502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 836/1669] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:11.527063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.527489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.527747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 834/1670] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:11.527845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.528680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:11.538248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:11.616114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] MFA Rules not processed for user `40bf380725314c509aa4b7d230e4c1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:11.617372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:11.759466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a39e-353f-47e9-9a00-9614ef326bc7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.781050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.781722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.782017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.782414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.839093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 837/1671] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:11.844084 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:11.844815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:11.879762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7493-4a4a-4c82-83e5-13ec28b5e423 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:11.889376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7285c4-454f-494b-a23b-8a694afd4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:11.891438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7285c4-454f-494b-a23b-8a694afd4be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:11.891884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7285c4-454f-494b-a23b-8a694afd4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:11.892499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7285c4-454f-494b-a23b-8a694afd4be5 admin admin] PATH_INFO: `/v3/projects/794c6a8ee0ae4394b4546c5f8f60bc55/users/e98121c4810f4c8f9a6fdd4c65aaba27/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:11.924639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.926317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.937395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7285c4-454f-494b-a23b-8a694afd4be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794c6a8ee0ae4394b4546c5f8f60bc55, user_id=e98121c4810f4c8f9a6fdd4c65aaba27, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:11.945658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7285c4-454f-494b-a23b-8a694afd4be5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:11.962566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 835/1672] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:11.964682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.001536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 838/1673] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:11 2022] PUT /identity/v3/projects/794c6a8ee0ae4394b4546c5f8f60bc55/users/e98121c4810f4c8f9a6fdd4c65aaba27/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:12.003419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.003812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.004107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.016350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b23ceb-8ee5-4f8c-8f8a-96efed713514 service nova] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.130800 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] MFA Rules not processed for user `e98121c4810f4c8f9a6fdd4c65aaba27`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:12.135636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:12.196004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.198037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.198515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.198906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.200079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.203157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.282192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 836/1674] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:11 2022] POST /identity/v3/projects => generated 369 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:12.291947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.372951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:12.467137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 839/1675] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:12.475125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.502492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505c89-15f0-4dfe-8b72-7b0b481b13df None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.507825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249abd7-5d6a-41a1-b39d-2880cc64d43e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.517905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.518660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.518949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.519229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.519936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.522337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.523034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.523732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.525174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.527143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.527942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.533238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.579876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 837/1676] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:12 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:12.584501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.598247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac9413-ad07-4a81-841f-d198f0ad44a8 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.598787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 840/1677] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:12 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:12.604489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.649154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:12.683212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.683212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.683212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.683212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.687550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.692825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.727309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 838/1678] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:12.728834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.751401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890cb3-0a99-4c02-9bc4-65d31e7779b1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.757447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e9dc-e540-4a60-a776-a479f3eef7c5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.768452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.769159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.769448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.771026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.771769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.773058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.773822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.773999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.774262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.775147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] PATH_INFO: `/v3/projects/07d957876afd408fa28de18b8bd7a193/users/84152920a2154d779bf52ca91b1bb07f/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.823013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d957876afd408fa28de18b8bd7a193, user_id=84152920a2154d779bf52ca91b1bb07f, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.825848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 841/1679] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:12 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:12.828505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.830919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.851558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620737-1f2c-4bc2-8374-11ca88c54b50 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:12.860991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 839/1680] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:12 2022] PUT /identity/v3/projects/07d957876afd408fa28de18b8bd7a193/users/84152920a2154d779bf52ca91b1bb07f/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:12.862316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:12.863018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:12.863306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:12.863738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:12.864986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:12.865644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.869788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:12.905899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 842/1681] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:12.907039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:12.933187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ab79-9db6-48ad-812e-50db59b8ee4f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:13.035865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae0243-2dc7-4456-b69f-944754249c54 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:13.048757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:13.051308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.051634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.051922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.054918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:13.059054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:13.064435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:13.065453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.065744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.068208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] PATH_INFO: `/v3/projects/731eca550df7444e97f213dc755ed043/users/e55002d509d84a28b90b0da7db1cc546/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.089754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 840/1682] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:13.096523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:13.110883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731eca550df7444e97f213dc755ed043, user_id=e55002d509d84a28b90b0da7db1cc546, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:13.130309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:13.131891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957cf5-5461-4b1e-a7b8-3918906a8e1f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:13.147102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50f666-4d5c-4469-90b1-27382c16f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:13.148501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f666-4d5c-4469-90b1-27382c16f6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.149037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f666-4d5c-4469-90b1-27382c16f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.149620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f666-4d5c-4469-90b1-27382c16f6c4 admin admin] PATH_INFO: `/v3/projects/07d957876afd408fa28de18b8bd7a193/users/84152920a2154d779bf52ca91b1bb07f/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.153806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50f666-4d5c-4469-90b1-27382c16f6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d957876afd408fa28de18b8bd7a193, user_id=84152920a2154d779bf52ca91b1bb07f, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:13.164951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50f666-4d5c-4469-90b1-27382c16f6c4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:13.184836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 843/1684] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:12 2022] PUT /identity/v3/projects/731eca550df7444e97f213dc755ed043/users/e55002d509d84a28b90b0da7db1cc546/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:13.188180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:13.194029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 841/1684] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:13 2022] PUT /identity/v3/projects/07d957876afd408fa28de18b8bd7a193/users/84152920a2154d779bf52ca91b1bb07f/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:13.195711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.196013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.196350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.241003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] MFA Rules not processed for user `84152920a2154d779bf52ca91b1bb07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:13.242844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:13.276057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:13.347745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 842/1685] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:13.356057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:13.359601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:13.385178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca74eb1-99da-46d5-bd70-978852bce225 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:13.400883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:13.495686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150c68d-fe4d-4c6e-b273-434aebc8d86e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:13.507853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:13.512333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.512748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.515071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.536960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72be2f-9ccd-4bb3-a720-91ef699d9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:13.537760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72be2f-9ccd-4bb3-a720-91ef699d9efb admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.538055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72be2f-9ccd-4bb3-a720-91ef699d9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.538454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72be2f-9ccd-4bb3-a720-91ef699d9efb admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.539202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:13.539312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72be2f-9ccd-4bb3-a720-91ef699d9efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:13.541026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72be2f-9ccd-4bb3-a720-91ef699d9efb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:13.542403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:13.555758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 843/1686] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:13.595857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 844/1687] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:13.601276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:13.634417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbba01-c5f4-40f3-a668-b70aaa007c6f service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:13.661482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:13.665741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.667763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.668944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] PATH_INFO: `/v3/projects/731eca550df7444e97f213dc755ed043/users/e55002d509d84a28b90b0da7db1cc546/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.691515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731eca550df7444e97f213dc755ed043, user_id=e55002d509d84a28b90b0da7db1cc546, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:13.695910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:13.738976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 844/1688] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:13 2022] PUT /identity/v3/projects/731eca550df7444e97f213dc755ed043/users/e55002d509d84a28b90b0da7db1cc546/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:13.750148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:13.750757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:13.751261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:13.815969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] MFA Rules not processed for user `e55002d509d84a28b90b0da7db1cc546`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:13.817996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:14.036490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 845/1689] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:14.049721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:14.168068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125599-a7d2-4786-9999-ea3793208550 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:14.175501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcdc8f-925e-40e4-82cd-0148d72b1f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:14.177660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcdc8f-925e-40e4-82cd-0148d72b1f1e service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:14.177938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcdc8f-925e-40e4-82cd-0148d72b1f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:14.178319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcdc8f-925e-40e4-82cd-0148d72b1f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:14.368528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcdc8f-925e-40e4-82cd-0148d72b1f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:14.379662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcdc8f-925e-40e4-82cd-0148d72b1f1e service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:14.399476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 845/1690] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:16.596921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:16.598570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:16.757902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:16.826690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6805c6-4351-467b-a19a-84cceb564b16 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:16.845658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:16.847040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:16.847356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:16.847645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] PATH_INFO: `/v3/users/ffa73d657a3345368276bc55bd5fe1f9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:16.867363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa73d657a3345368276bc55bd5fe1f9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:16.869353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:17.035557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa73d657a3345368276bc55bd5fe1f9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:17.061910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f034-f09d-4865-899e-81f7514561e7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:17.062396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f034-f09d-4865-899e-81f7514561e7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:17.062542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f034-f09d-4865-899e-81f7514561e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:17.073104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa73d657a3345368276bc55bd5fe1f9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:17.075042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa73d657a3345368276bc55bd5fe1f9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:17.077903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa73d657a3345368276bc55bd5fe1f9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:17.095538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5df5389d-b2d9-4521-813e-c59bc00cb2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa73d657a3345368276bc55bd5fe1f9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:17.138937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 846/1691] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:16 2022] DELETE /identity/v3/users/ffa73d657a3345368276bc55bd5fe1f9 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:17.144425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:17.144727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:17.145010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:17.145518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-70b4f034-f09d-4865-899e-81f7514561e7 None None] MFA Rules not processed for user `831d1557afd649518d34d4f970f96674`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:17.147369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-70b4f034-f09d-4865-899e-81f7514561e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:17.209733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:17.224102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:17.324264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:17.342399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 846/1692] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:17.357787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:17.358598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:17.359767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:17.410625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] MFA Rules not processed for user `831d1557afd649518d34d4f970f96674`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:17.412057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:17.434415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 847/1693] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:17.440285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 847/1694] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:17.450183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:17.451671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:17.456878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:17.458278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:17.657318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a589d11-73e7-4fd3-b63d-731de2fafaa4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:17.670126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:17.671447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:17.671744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:17.676334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:17.705766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac18c69-c867-4e0c-a033-5141b073e3d4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:17.715232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:17.718989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:17.734857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8640f8-f7e7-42f9-bc33-2207e9a3dad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:17.735581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8640f8-f7e7-42f9-bc33-2207e9a3dad3 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:17.736697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8640f8-f7e7-42f9-bc33-2207e9a3dad3 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:17.737249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8640f8-f7e7-42f9-bc33-2207e9a3dad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:17.747058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 848/1695] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:17.751377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:17.762069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8640f8-f7e7-42f9-bc33-2207e9a3dad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:17.772009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8640f8-f7e7-42f9-bc33-2207e9a3dad3 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:17.799608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 848/1696] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:18.223204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:18.225346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:18.246688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d5411-269d-483a-9bba-3b9de14d2705 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:18.252745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:18.253733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:18.254085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:18.254462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] PATH_INFO: `/v3/users/40bf380725314c509aa4b7d230e4c1b4` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:18.255811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bf380725314c509aa4b7d230e4c1b4)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:18.257911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:18.367803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bf380725314c509aa4b7d230e4c1b4'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:18.368736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bf380725314c509aa4b7d230e4c1b4'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:18.381623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bf380725314c509aa4b7d230e4c1b4'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:18.383052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bf380725314c509aa4b7d230e4c1b4'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:18.403866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bf380725314c509aa4b7d230e4c1b4'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:18.512651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 849/1697] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:18 2022] DELETE /identity/v3/users/40bf380725314c509aa4b7d230e4c1b4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:18.521260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:18.521787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:18.524630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:18.600774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:18.602254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:18.732942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:18.734973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:18.803055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 849/1698] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:18.854232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:18.856041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:18.885962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3d766-3ea9-4da1-8d6e-ebbbb8a7bc32 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:18.893099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:18.893982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:18.894267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:18.895080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] PATH_INFO: `/v3/projects/e7b6c65434d94f59be68e2d66bbcff14` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:18.896906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b6c65434d94f59be68e2d66bbcff14)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:18.897976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: WARNING py.warnings [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:45:18.897976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: warnings.warn(msg) Jul 19 15:45:18.897976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: Jul 19 15:45:18.900443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:18.904199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:19.019876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b6c65434d94f59be68e2d66bbcff14', 'request_id': 'req-d951c84c-36e0-402d-9f0c-4c6f8bddc962'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:19.032393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3bec6-8176-4ec5-9f45-c3586c881fda None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:19.035033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b6c65434d94f59be68e2d66bbcff14', 'request_id': 'req-d951c84c-36e0-402d-9f0c-4c6f8bddc962'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:19.059052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b6c65434d94f59be68e2d66bbcff14', 'request_id': 'req-d951c84c-36e0-402d-9f0c-4c6f8bddc962'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:19.098394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] The token cache is being invalidate because project e7b6c65434d94f59be68e2d66bbcff14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:19.098709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:19.099531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d951c84c-36e0-402d-9f0c-4c6f8bddc962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:19.105196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 850/1699] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:18 2022] DELETE /identity/v3/projects/e7b6c65434d94f59be68e2d66bbcff14 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:19.107414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8658049-a8ed-4b39-97fd-904b94a092f2 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.108033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8658049-a8ed-4b39-97fd-904b94a092f2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.108941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8658049-a8ed-4b39-97fd-904b94a092f2 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.120053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 851/1700] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 19 15:45:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:19.122621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2619-fbc7-46c3-80db-eedae54b594d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.124077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2619-fbc7-46c3-80db-eedae54b594d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.124377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2619-fbc7-46c3-80db-eedae54b594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.161267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:19.164531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.165406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.166662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.169787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.197052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-317f2619-fbc7-46c3-80db-eedae54b594d None None] MFA Rules not processed for user `2d7c42cf0bc84292bb0b7edb9f2e7fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:19.199782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-317f2619-fbc7-46c3-80db-eedae54b594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.333847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:19.336130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc2e1d-4c9a-4785-a5a3-a995bda4ac7b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:19.354234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:19.360835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 852/1701] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:19.362464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.362969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.363257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.369186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 850/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:19.370525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583bfbc-3282-45c7-951f-19af1c1922b2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.370816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583bfbc-3282-45c7-951f-19af1c1922b2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.371095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583bfbc-3282-45c7-951f-19af1c1922b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.406759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:19.408789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.430263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 853/1703] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:19.436614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:19.436614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.451151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e583bfbc-3282-45c7-951f-19af1c1922b2 None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:19.452765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e583bfbc-3282-45c7-951f-19af1c1922b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.478940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 851/1704] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:19.480689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.480824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.481022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.520113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:19.521433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.541197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 852/1705] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:19.542399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:19.557907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca38e6-c129-464f-8434-16e495c7bae5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:19.577910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:19.578907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.579156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.579432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.580554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:19.581688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:19.583508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:19.610181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9327e16-9397-4d92-a072-a3d84dace9ad None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:19.618685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3b6ef-6e9d-4d99-9043-0f22acc52d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:19.619562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3b6ef-6e9d-4d99-9043-0f22acc52d43 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.619948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3b6ef-6e9d-4d99-9043-0f22acc52d43 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.620249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3b6ef-6e9d-4d99-9043-0f22acc52d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.640995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 853/1706] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:19.640995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:19.644869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.660066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3b6ef-6e9d-4d99-9043-0f22acc52d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:19.663912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3b6ef-6e9d-4d99-9043-0f22acc52d43 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:19.674746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:19.683968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 854/1707] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:19.688589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.689126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad172b3-cc2c-4bd9-862b-4351b1685e56 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:19.691207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.691572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.714872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:19.717499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.719924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.721558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.741580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:19.747411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:19.769283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] MFA Rules not processed for user `4785719411fd4af892868d99fca7cd71`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:19.774696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.778936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 854/1708] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:19.779860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:19.802934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5394f5-a3d9-4df5-b82b-a3a14a57f463 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:19.808482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d95e-1023-46ef-9456-8add366a3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:19.810199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d95e-1023-46ef-9456-8add366a3c98 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.810825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d95e-1023-46ef-9456-8add366a3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.811252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d95e-1023-46ef-9456-8add366a3c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.813284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805d95e-1023-46ef-9456-8add366a3c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:19.815408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805d95e-1023-46ef-9456-8add366a3c98 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:19.885916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 855/1709] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:19.885916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:19.885916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:19.885916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:19.956422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] MFA Rules not processed for user `fca86639f2d344be97cb1529dc17f62a`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:19.958170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:19.966733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 855/1710] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:19.968531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:19.994918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64349e13-4271-4651-b567-c8ef334645e9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:20.123192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593f10-abe5-4509-83bb-f25b65d54e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:20.124136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593f10-abe5-4509-83bb-f25b65d54e87 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.124425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593f10-abe5-4509-83bb-f25b65d54e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.124707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593f10-abe5-4509-83bb-f25b65d54e87 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.125425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4593f10-abe5-4509-83bb-f25b65d54e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:20.127561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4593f10-abe5-4509-83bb-f25b65d54e87 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:20.176728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 856/1711] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:20.178256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.178652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.178938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.220899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] MFA Rules not processed for user `4785719411fd4af892868d99fca7cd71`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:20.223178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.237797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 856/1712] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:20.243011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:20.298702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fce25-ba46-460a-9dbe-58393b24c6ef None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:20.313559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:20.314664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.315155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.315628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.316579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:20.332030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:20.357708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 857/1713] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:20.357708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:20.365424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.395065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc59a83-0bf7-42e9-a3cf-68bf425d97c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:20.407902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:20.409824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.410442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.410884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] PATH_INFO: `/v3/projects/f57965a6d2b343c49581d396631c913e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.413407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57965a6d2b343c49581d396631c913e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:20.417087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:20.427637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 857/1714] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:20.429300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:20.431706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.514196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:20.543820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57965a6d2b343c49581d396631c913e', 'request_id': 'req-1b29ac24-a472-4661-b2f2-4be4e755bd29'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.564257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57965a6d2b343c49581d396631c913e', 'request_id': 'req-1b29ac24-a472-4661-b2f2-4be4e755bd29'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.574464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57965a6d2b343c49581d396631c913e', 'request_id': 'req-1b29ac24-a472-4661-b2f2-4be4e755bd29'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.601879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] The token cache is being invalidate because project f57965a6d2b343c49581d396631c913e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:20.602506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.603422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.604959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72123e08-c6cf-46a6-b4c0-337c4b270ef3 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:20.605475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 858/1715] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:20 2022] DELETE /identity/v3/projects/f57965a6d2b343c49581d396631c913e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:20.606618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:20.609281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.617390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:20.700066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ac24-a472-4661-b2f2-4be4e755bd29 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:20.707399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:20.708429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.709078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.709901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.711953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:20.713759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:20.735798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:20.735798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.736237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.736347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.737079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 859/1716] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:20.738322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:20.741422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.743988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.761141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5933f-d0a5-4ca9-9a1b-053ce180ede1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:20.769273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:20.771027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:20.771631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:20.772154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] PATH_INFO: `/v3/users/84152920a2154d779bf52ca91b1bb07f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:20.774048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84152920a2154d779bf52ca91b1bb07f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:20.777793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:20.898815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:20.899334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:20.902842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84152920a2154d779bf52ca91b1bb07f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.918023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 858/1717] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:20.918988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:20.920531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:20.951411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84152920a2154d779bf52ca91b1bb07f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.953046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84152920a2154d779bf52ca91b1bb07f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.957716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84152920a2154d779bf52ca91b1bb07f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:20.986664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84152920a2154d779bf52ca91b1bb07f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:21.035422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 860/1718] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:20 2022] DELETE /identity/v3/users/84152920a2154d779bf52ca91b1bb07f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:21.035422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:21.037423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:21.173814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470abb-5471-4ff2-bd3c-acde77a85068 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:21.253675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4a076-f137-4f61-9491-8b1615669968 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:21.267598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:21.269910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5dde-dacb-435d-add7-5f8b18a2620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:21.276924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5dde-dacb-435d-add7-5f8b18a2620f admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.278221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5dde-dacb-435d-add7-5f8b18a2620f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.279648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5dde-dacb-435d-add7-5f8b18a2620f admin admin] PATH_INFO: `/v3/projects/5645b6b3cef342edad1e9936afb69dc7/users/01d4a939eb434fac8fb23eb9ae457d49/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.327994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c5dde-dacb-435d-add7-5f8b18a2620f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5645b6b3cef342edad1e9936afb69dc7, user_id=01d4a939eb434fac8fb23eb9ae457d49, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:21.333349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c5dde-dacb-435d-add7-5f8b18a2620f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:21.338398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:21.385854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 861/1719] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:21 2022] PUT /identity/v3/projects/5645b6b3cef342edad1e9936afb69dc7/users/01d4a939eb434fac8fb23eb9ae457d49/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:21.387772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb965f-d628-430a-97eb-10e463833442 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.388066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb965f-d628-430a-97eb-10e463833442 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.388353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb965f-d628-430a-97eb-10e463833442 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.392412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 862/1720] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 19 15:45:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:21.393141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb965f-d628-430a-97eb-10e463833442 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:21.394998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f2bb965f-d628-430a-97eb-10e463833442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:21.398541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:21.399217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.399504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.399785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.401738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:21.582217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:21.587123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048a9a2-b3ba-4a48-8f7e-9d634ddb982d service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:21.609974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb965f-d628-430a-97eb-10e463833442 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:21.621375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:21.622300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.626315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.626469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] PATH_INFO: `/v3/users/d4803fb1cc444c3b8307143af3fe01d0` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.628405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4803fb1cc444c3b8307143af3fe01d0)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:21.628741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 859/1721] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:21.631312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf570-e64c-45b6-b5ca-38a2b9910964 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.631647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf570-e64c-45b6-b5ca-38a2b9910964 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.631894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf570-e64c-45b6-b5ca-38a2b9910964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.636998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:21.710011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c65bf570-e64c-45b6-b5ca-38a2b9910964 None None] MFA Rules not processed for user `01d4a939eb434fac8fb23eb9ae457d49`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:21.711506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c65bf570-e64c-45b6-b5ca-38a2b9910964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:21.750506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4803fb1cc444c3b8307143af3fe01d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:21.783561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4803fb1cc444c3b8307143af3fe01d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:21.784262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4803fb1cc444c3b8307143af3fe01d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:21.785153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4803fb1cc444c3b8307143af3fe01d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:21.809297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 860/1722] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:21.810175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c58d0758-a882-4c4f-a60a-848f3cdab8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4803fb1cc444c3b8307143af3fe01d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:21.810725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760c440-a0e6-4464-9212-5ab2df3f6e09 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.811024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760c440-a0e6-4464-9212-5ab2df3f6e09 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.812206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760c440-a0e6-4464-9212-5ab2df3f6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.836947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2760c440-a0e6-4464-9212-5ab2df3f6e09 None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:21.838656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2760c440-a0e6-4464-9212-5ab2df3f6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:21.839945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 863/1723] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:21 2022] DELETE /identity/v3/users/d4803fb1cc444c3b8307143af3fe01d0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:21.843775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f640c9-cdab-4d95-97c2-aec5767acba7 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:21.843775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f640c9-cdab-4d95-97c2-aec5767acba7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:21.843775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f640c9-cdab-4d95-97c2-aec5767acba7 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:21.853693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 864/1724] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 19 15:45:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:21.854704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f640c9-cdab-4d95-97c2-aec5767acba7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:21.856539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-39f640c9-cdab-4d95-97c2-aec5767acba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:21.963863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:22.003118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 861/1725] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 19 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:22.004548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418d2e-4f9c-4508-a4f0-e2e6149b2f41 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.004889 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418d2e-4f9c-4508-a4f0-e2e6149b2f41 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.005183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418d2e-4f9c-4508-a4f0-e2e6149b2f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.037108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f640c9-cdab-4d95-97c2-aec5767acba7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.037525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-22418d2e-4f9c-4508-a4f0-e2e6149b2f41 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:22.038485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-22418d2e-4f9c-4508-a4f0-e2e6149b2f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.052131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.053729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.054264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.054783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.056720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.056838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 862/1726] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:22.061122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.062661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.063001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.063353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.110177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:22.112019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:22.113754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.135010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 865/1727] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:21 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:22.139029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.303521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 863/1728] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:22.304865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.306969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.313439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220eb22-3be9-405f-b7a9-f22d833f9b75 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.324163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.324754 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf47057-a39f-4f21-8c19-cf7abd1526ca None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.325065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.325446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.325968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.330595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.349633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.351683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.367372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 866/1729] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:22.368635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.402687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.403490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.403848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.404251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.476287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26655f3-6b06-4684-841f-402a27819598 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.481318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.482853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.483314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.485657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.487240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.489691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.518004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.520370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.528402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 867/1730] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:22 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:22.529041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.532269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.552218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f427ea4-c21a-4fff-b985-4c9bea17f172 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.556741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 864/1731] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:22.557972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.558590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.559478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.559801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.560034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] PATH_INFO: `/v3/projects/07d957876afd408fa28de18b8bd7a193` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.562176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d957876afd408fa28de18b8bd7a193)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.563388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.564936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.580054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71bb1-14c3-4358-bb29-a27baa357fa4 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.584971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.585635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.585918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.586390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.596394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.598291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.620900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 865/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:22.622091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.636994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d957876afd408fa28de18b8bd7a193', 'request_id': 'req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:22.647211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d957876afd408fa28de18b8bd7a193', 'request_id': 'req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:22.656409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289139c1-3762-49d0-8c8e-8ded4fcfc357 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:22.680163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d957876afd408fa28de18b8bd7a193', 'request_id': 'req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:22.711830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:22.719263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] The token cache is being invalidate because project 07d957876afd408fa28de18b8bd7a193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:22.720168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:22.721635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-84020d5b-ca3c-4fa6-8b54-98dbc42cf324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:22.726440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 868/1733] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:22 2022] DELETE /identity/v3/projects/07d957876afd408fa28de18b8bd7a193 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:22.731377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c79bb7-8957-41f9-bf23-cc36d2455c66 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.731921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c79bb7-8957-41f9-bf23-cc36d2455c66 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.732174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c79bb7-8957-41f9-bf23-cc36d2455c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.759758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f8c79bb7-8957-41f9-bf23-cc36d2455c66 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:22.760980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f8c79bb7-8957-41f9-bf23-cc36d2455c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:22.775058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:22.877913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:22.878724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.879016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.879301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.880049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:22.888187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:22.938256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 869/1734] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:22.943379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 866/1735] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:22.948722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:22.949134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:22.949467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:22.949754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:22.961264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:23.021872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c4543-7368-405e-a2ff-439869537d19 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.037497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.041550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:23.042052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.042268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.042757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] PATH_INFO: `/v3/projects/f66dd676c4a342f4bf4a0ef8cfe9612e/users/e85d25e49e8c4fc7b9b4c98e192a258e/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.042872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:23.069847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 870/1736] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:23.074169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.084689 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66dd676c4a342f4bf4a0ef8cfe9612e, user_id=e85d25e49e8c4fc7b9b4c98e192a258e, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.088392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.106757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a0c2-fe2f-401b-9072-6f496910ba79 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.126896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 867/1737] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:22 2022] PUT /identity/v3/projects/f66dd676c4a342f4bf4a0ef8cfe9612e/users/e85d25e49e8c4fc7b9b4c98e192a258e/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:23.130900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.232428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.235429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.235429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.237256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.238447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:23.240425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.243519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.274952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 871/1738] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:45:23.278526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.322261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec036a5-edfb-4689-8e41-dc3a4a83a046 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.341731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.345480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.346553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.347603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea209-2d58-488c-9f79-4c8f8be2ff99 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.347941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.349606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.358592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.364500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697916b-d87f-4d00-9f4d-80a09c00acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.370091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697916b-d87f-4d00-9f4d-80a09c00acd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.371708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697916b-d87f-4d00-9f4d-80a09c00acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.372056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697916b-d87f-4d00-9f4d-80a09c00acd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.373485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697916b-d87f-4d00-9f4d-80a09c00acd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.378055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697916b-d87f-4d00-9f4d-80a09c00acd9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.400393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 868/1739] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:23.403621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.405542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.405542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.424751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 872/1740] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:23 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:23.426395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.455600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] MFA Rules not processed for user `4785719411fd4af892868d99fca7cd71`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:23.459624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:23.599442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137ef86-50cd-4987-8322-08ff1869b17c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.605201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 869/1741] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:23.606452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.626428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f6179-c5cc-42fb-bf4b-cdc041e2a095 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.632651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.633492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.633904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.634284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.634540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683aa98-8b0e-4dc8-ad48-3badc5d012d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.635271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.635454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683aa98-8b0e-4dc8-ad48-3badc5d012d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.635744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683aa98-8b0e-4dc8-ad48-3badc5d012d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.636023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683aa98-8b0e-4dc8-ad48-3badc5d012d3 admin admin] PATH_INFO: `/v3/projects/f66dd676c4a342f4bf4a0ef8cfe9612e/users/e85d25e49e8c4fc7b9b4c98e192a258e/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.637783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.643279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683aa98-8b0e-4dc8-ad48-3badc5d012d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66dd676c4a342f4bf4a0ef8cfe9612e, user_id=e85d25e49e8c4fc7b9b4c98e192a258e, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.645955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683aa98-8b0e-4dc8-ad48-3badc5d012d3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.666036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 870/1742] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:23 2022] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:23.679599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.680103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:23.690423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 873/1743] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:23 2022] PUT /identity/v3/projects/f66dd676c4a342f4bf4a0ef8cfe9612e/users/e85d25e49e8c4fc7b9b4c98e192a258e/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:23.716163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.717066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.717365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.734704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49838f3-ab0f-4ff7-9164-d03ea09afcc1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.783535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] MFA Rules not processed for user `e85d25e49e8c4fc7b9b4c98e192a258e`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:23.787967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:23.798120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:23.890037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.891008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.891334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.891623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.893441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:23.897455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:23.925517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 871/1744] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:23.929430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.960997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 874/1745] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:23.964181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351094-e1cb-4e1f-959d-ce391a47e317 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:23.973716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:23.975239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:23.982839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108167-c6e5-4704-9809-089517d298da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:23.985337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108167-c6e5-4704-9809-089517d298da admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:23.986077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108167-c6e5-4704-9809-089517d298da admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:23.990309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108167-c6e5-4704-9809-089517d298da admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:23.992939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108167-c6e5-4704-9809-089517d298da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:24.002934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108167-c6e5-4704-9809-089517d298da admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:24.065808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 872/1746] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:24.067110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108167-c6e5-4704-9809-089517d298da admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:24.080558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-36108167-c6e5-4704-9809-089517d298da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:24.107310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108167-c6e5-4704-9809-089517d298da admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:24.119315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:24.121198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:24.121198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:24.121198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] PATH_INFO: `/v3/projects/ad63f6ea40454c9081f5e817db60041d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:24.123078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad63f6ea40454c9081f5e817db60041d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:24.127280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:24.187468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23fd50-037c-4fa9-ae0f-cc12a47ce426 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:24.198099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:24.199381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:24.200912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:24.201211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:24.243924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad63f6ea40454c9081f5e817db60041d', 'request_id': 'req-bfe52630-9c58-40a6-ac81-16a891521668'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.248366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:24.250895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:24.255548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad63f6ea40454c9081f5e817db60041d', 'request_id': 'req-bfe52630-9c58-40a6-ac81-16a891521668'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.273796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad63f6ea40454c9081f5e817db60041d', 'request_id': 'req-bfe52630-9c58-40a6-ac81-16a891521668'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.293894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 875/1747] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:24.294605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:24.303143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] The token cache is being invalidate because project ad63f6ea40454c9081f5e817db60041d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:24.303320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.305213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.313701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 873/1748] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:24 2022] DELETE /identity/v3/projects/ad63f6ea40454c9081f5e817db60041d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:24.315314 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:24.319900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:24.320016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155631b-ea3c-458f-b3ef-7979cc4bbf79 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:24.556406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:24.560226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:24.560540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:24.560903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] PATH_INFO: `/v3/projects/bb37b1c4a1004ef28918c34c05ce9206/users/19690314afaf474bb5c2074e8cc4edfe/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:24.613070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb37b1c4a1004ef28918c34c05ce9206, user_id=19690314afaf474bb5c2074e8cc4edfe, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:24.618155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe52630-9c58-40a6-ac81-16a891521668 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:24.620371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:24.630545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:24.642343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:24.644471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:24.645212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] PATH_INFO: `/v3/users/c2fb262af1bb46e4b62811c7fc977ab0` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:24.654049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fb262af1bb46e4b62811c7fc977ab0)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:24.658164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:24.695551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 876/1749] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:24 2022] PUT /identity/v3/projects/bb37b1c4a1004ef28918c34c05ce9206/users/19690314afaf474bb5c2074e8cc4edfe/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:24.702626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:24.707121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:24.759330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:24.836504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:24.909610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fb262af1bb46e4b62811c7fc977ab0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.915293 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fb262af1bb46e4b62811c7fc977ab0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.928047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5f56-f479-4bbe-83e2-5224783509bc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:24.944467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:24.945130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fb262af1bb46e4b62811c7fc977ab0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.947439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fb262af1bb46e4b62811c7fc977ab0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:24.950815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:24.951124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:24.951418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:24.958924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:24.973836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-209803a2-6602-4ab0-90de-95949c596845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fb262af1bb46e4b62811c7fc977ab0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:25.042080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 874/1750] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:24 2022] DELETE /identity/v3/users/c2fb262af1bb46e4b62811c7fc977ab0 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:25.044684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:25.044986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:25.045272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:25.166336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] MFA Rules not processed for user `19690314afaf474bb5c2074e8cc4edfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:25.167847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:25.220066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:25.228236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9cdb1-aed0-4236-9b40-da0fb4735f5f service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:25.261709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 877/1751] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:25.264870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:25.265124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:25.265477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:25.369159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] MFA Rules not processed for user `2d7c42cf0bc84292bb0b7edb9f2e7fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:25.378560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:25.481898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 875/1752] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:25.482834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:25.488447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:25.629294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 878/1753] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:25.717351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400a3c8-4285-41af-9bec-a2f5830e572b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:25.725696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:25.727030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:25.727495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:25.728248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:25.729134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:25.734542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:25.906517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 876/1754] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:25 2022] POST /identity/v3/projects => generated 385 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:25.911335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:25.960569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb10b7-1310-45f9-8ef7-54072dc8fad6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:26.258022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:26.260590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:26.260590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:26.260773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:26.261424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:26.290972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:26.339003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:26.351170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:26.352115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 879/1755] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:25 2022] POST /identity/v3/users => generated 299 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:26.366683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed6f6-8364-4016-a3a8-ef5c64f613c9 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:26.380614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:26.381840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:26.382512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:26.383002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:26.384348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:26.389573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:26.399148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:26.401002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:26.433508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377350-d1e0-410c-b929-d7ff0b3b45be admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:26.443592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 877/1756] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:26.446034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:26.456682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:26.460486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:26.460748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:26.462053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] PATH_INFO: `/v3/projects/ef3360b2c9284de891207a1f5a61ad9b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:26.467270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3360b2c9284de891207a1f5a61ad9b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:26.474676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:26.479106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e8464-12c2-47eb-83cb-e9558f06de3a admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:26.506069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:26.507031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:26.507320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:26.507607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] PATH_INFO: `/v3/projects/22bea8aad72e43ea92e73e6db63795dd/users/4621f86046bd4305b1035a0735f42074/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:26.564734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bea8aad72e43ea92e73e6db63795dd, user_id=4621f86046bd4305b1035a0735f42074, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:26.582700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:26.594903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:26.651387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 878/1757] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:26 2022] PUT /identity/v3/projects/22bea8aad72e43ea92e73e6db63795dd/users/4621f86046bd4305b1035a0735f42074/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:26.654075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:26.717678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3360b2c9284de891207a1f5a61ad9b', 'request_id': 'req-c8867681-95bd-49fd-9e88-960932a685a6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:26.745392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3360b2c9284de891207a1f5a61ad9b', 'request_id': 'req-c8867681-95bd-49fd-9e88-960932a685a6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:26.794856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3360b2c9284de891207a1f5a61ad9b', 'request_id': 'req-c8867681-95bd-49fd-9e88-960932a685a6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:26.855152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] The token cache is being invalidate because project ef3360b2c9284de891207a1f5a61ad9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:26.855464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:26.860022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8867681-95bd-49fd-9e88-960932a685a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:26.870858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 880/1758] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:26 2022] DELETE /identity/v3/projects/ef3360b2c9284de891207a1f5a61ad9b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:26.881673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a687-d6e7-41d1-bb44-585ef7633da9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:26.882055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a687-d6e7-41d1-bb44-585ef7633da9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:26.882396 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a687-d6e7-41d1-bb44-585ef7633da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:26.979954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ac85a687-d6e7-41d1-bb44-585ef7633da9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:26.981204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ac85a687-d6e7-41d1-bb44-585ef7633da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:27.027741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20cb0f-f0bb-4958-be08-9db99f7662cb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.217846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.219859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.220321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.222738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.223695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:27.225581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:27.229569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 881/1759] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:27.244065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.246300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.247185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.253874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 879/1760] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:27.258650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:27.260698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:27.285441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280cb1-8822-427f-a379-206f2eb43a5c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.318405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467c481-1747-46ca-a082-cc2f62cb3f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.319359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c481-1747-46ca-a082-cc2f62cb3f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.320831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c481-1747-46ca-a082-cc2f62cb3f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.321318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c481-1747-46ca-a082-cc2f62cb3f15 admin admin] PATH_INFO: `/v3/projects/22bea8aad72e43ea92e73e6db63795dd/users/4621f86046bd4305b1035a0735f42074/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.327747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467c481-1747-46ca-a082-cc2f62cb3f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bea8aad72e43ea92e73e6db63795dd, user_id=4621f86046bd4305b1035a0735f42074, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:27.328445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:27.331770 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467c481-1747-46ca-a082-cc2f62cb3f15 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:27.333325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:27.361769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 882/1761] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:27.363611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:27.369569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 880/1762] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:27 2022] PUT /identity/v3/projects/22bea8aad72e43ea92e73e6db63795dd/users/4621f86046bd4305b1035a0735f42074/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:27.381202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.381726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.382377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.391174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc482f-4df4-4e48-816c-21b1a926f5e9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.476484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] MFA Rules not processed for user `4621f86046bd4305b1035a0735f42074`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:27.484304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:27.499046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.500903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.502871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.504457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.505840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:27.523283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:27.533192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:27.580726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 883/1763] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:45:27.584567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:27.606564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bf6e0-c1b9-4e48-a6a4-7adc550ca698 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.622268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.623145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.623539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.624595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.627002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:27.633749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:27.658418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 881/1764] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:27.663135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:27.675007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:27.680984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:27.704775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:27.728849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 884/1765] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:27 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:27.733216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:27.850201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fc11a-6065-4d5f-81b0-ca0383957d92 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.857815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df28697-6b54-45ba-ba99-4a411560198b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.870596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.871666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.871959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.875886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.876548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:27.878559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:27.916734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 885/1766] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:27 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:27.920743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:27.941058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e779a5-1c76-4d30-acf0-034ca9dce5c7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:27.957794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.963175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.963476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.963773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.964882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:27.969702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:27.986053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3d92-be57-4d77-a5f5-4a9cc53b9571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:27.988486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3d92-be57-4d77-a5f5-4a9cc53b9571 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:27.988819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3d92-be57-4d77-a5f5-4a9cc53b9571 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:27.989052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3d92-be57-4d77-a5f5-4a9cc53b9571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:27.995479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 886/1767] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:28.002261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.025127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174cd32-ad5c-4210-a498-da0fa323bcfa admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:28.039167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:28.039860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.040202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.040529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.043973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:28.047377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:28.075901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 887/1768] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:28.076612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.102924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956888-a2c1-4024-9952-7bdf47804f34 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:28.114147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:28.118762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.118762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.118762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] PATH_INFO: `/v3/projects/1006afc262904f55a5695ed9a9907266/users/f6afa3e8d01648c6b5b42a312a811b08/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.151216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3d92-be57-4d77-a5f5-4a9cc53b9571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:28.152675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3d92-be57-4d77-a5f5-4a9cc53b9571 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:28.172093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1006afc262904f55a5695ed9a9907266, user_id=f6afa3e8d01648c6b5b42a312a811b08, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:28.175073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:28.187680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 882/1769] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:28.225678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 888/1770] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:28 2022] PUT /identity/v3/projects/1006afc262904f55a5695ed9a9907266/users/f6afa3e8d01648c6b5b42a312a811b08/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:28.240364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.240718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.240990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.241275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.300677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] MFA Rules not processed for user `f6afa3e8d01648c6b5b42a312a811b08`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:28.302140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:28.442325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64231c-0101-46e6-977d-3eab207a69f6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:28.451456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:28.455637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.455934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.456221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] PATH_INFO: `/v3/users/19690314afaf474bb5c2074e8cc4edfe` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.462482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19690314afaf474bb5c2074e8cc4edfe)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:28.465234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:28.465829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 883/1771] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:28.467095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.477528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:28.486722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681e09-0e85-41b7-bdb8-97b35f24e5d6 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:28.494991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:28.496132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.496501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.497302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.497655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:28.502718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:28.548420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 884/1772] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:28 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:28.549597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.579655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:28.606376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19690314afaf474bb5c2074e8cc4edfe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:28.644817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19690314afaf474bb5c2074e8cc4edfe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:28.647825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19690314afaf474bb5c2074e8cc4edfe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:28.649321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19690314afaf474bb5c2074e8cc4edfe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:28.666295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d6e1a728-d143-42df-80f2-39b4a79c943d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19690314afaf474bb5c2074e8cc4edfe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:28.674789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228f48-73eb-4717-a5b9-2cdf3c54476e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:28.689676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:28.690521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.690814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.691095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.691894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:28.693968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:28.703512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 889/1773] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:28 2022] DELETE /identity/v3/users/19690314afaf474bb5c2074e8cc4edfe => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:28.708069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.708367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.708826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.731138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 885/1774] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:28 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:28.735231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.737401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:28.738748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:28.739534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:28.774876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88afb-031a-4e38-a348-0d580ce185b1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:28.855238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 890/1775] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:28.878636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.885683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:28.985838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:28.987641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:28.989124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:28.989427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:28.990212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.009193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1fe0-d1f5-4aa6-a8f3-f31d5f96dc51 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.011238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.013865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.015807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.016254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.016551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.033849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.036520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.050078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 891/1776] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:29.079553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.087481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 886/1777] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:29.105400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61fa3c-b522-4650-a3c8-a62dcb104cee service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.119331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.120461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.122663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.124656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] PATH_INFO: `/v3/projects/2bed4587564d4e3caf19de7239c2c6a2/users/827c19f8ac7a49df82a96846215b3472/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.169238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bed4587564d4e3caf19de7239c2c6a2, user_id=827c19f8ac7a49df82a96846215b3472, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.179844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.219277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 892/1778] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:29 2022] PUT /identity/v3/projects/2bed4587564d4e3caf19de7239c2c6a2/users/827c19f8ac7a49df82a96846215b3472/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:29.223876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.240604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba52b4-6f01-4bc6-a045-292bd9e55c4e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.442635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.445506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.446072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.446385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.446877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.447784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.449831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.450058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.475932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3ab4b-81a3-41ad-9101-e3013c906901 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.484410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 887/1779] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:29.488584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.490089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.491204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.491561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.492041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] PATH_INFO: `/v3/users/01d4a939eb434fac8fb23eb9ae457d49` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.493450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d4a939eb434fac8fb23eb9ae457d49)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.495713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.519864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:29.569298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:29.578529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6e97a-49ae-42ed-9b08-361460996166 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.600886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d4a939eb434fac8fb23eb9ae457d49'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.603910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021aa12-cb32-4bfc-a551-ff2004482f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.612782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021aa12-cb32-4bfc-a551-ff2004482f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.613117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021aa12-cb32-4bfc-a551-ff2004482f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.613582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021aa12-cb32-4bfc-a551-ff2004482f0e admin admin] PATH_INFO: `/v3/projects/2bed4587564d4e3caf19de7239c2c6a2/users/827c19f8ac7a49df82a96846215b3472/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.624721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021aa12-cb32-4bfc-a551-ff2004482f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bed4587564d4e3caf19de7239c2c6a2, user_id=827c19f8ac7a49df82a96846215b3472, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.627857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d4a939eb434fac8fb23eb9ae457d49'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.628695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d4a939eb434fac8fb23eb9ae457d49'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.629331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d4a939eb434fac8fb23eb9ae457d49'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.632115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021aa12-cb32-4bfc-a551-ff2004482f0e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.646076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59595427-9bfc-475b-bcd0-a58cc2f514ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d4a939eb434fac8fb23eb9ae457d49'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.660081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 888/1780] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:29 2022] PUT /identity/v3/projects/2bed4587564d4e3caf19de7239c2c6a2/users/827c19f8ac7a49df82a96846215b3472/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:29.676864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.676864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.676864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.688165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 893/1781] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:29 2022] DELETE /identity/v3/users/01d4a939eb434fac8fb23eb9ae457d49 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:29.690911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.691203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.691496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.713722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:29.715166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.721464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] MFA Rules not processed for user `827c19f8ac7a49df82a96846215b3472`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:29.722921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.807647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 894/1782] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:29.809006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.814789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.830216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30f888-4e63-4c5c-8bab-e35ffda73b39 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.835432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 889/1783] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:29.836318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.838146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.839278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.840468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.840896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.841417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] PATH_INFO: `/v3/projects/bb37b1c4a1004ef28918c34c05ce9206` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.843699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb37b1c4a1004ef28918c34c05ce9206)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.846021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.954411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb37b1c4a1004ef28918c34c05ce9206', 'request_id': 'req-9e405b43-2f21-483a-8744-c636f1ea484c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.982574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb37b1c4a1004ef28918c34c05ce9206', 'request_id': 'req-9e405b43-2f21-483a-8744-c636f1ea484c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:29.991606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb37b1c4a1004ef28918c34c05ce9206', 'request_id': 'req-9e405b43-2f21-483a-8744-c636f1ea484c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.006389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f6f6-85af-4260-a5d9-edc5514b303d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:30.022541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] The token cache is being invalidate because project bb37b1c4a1004ef28918c34c05ce9206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:30.023122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.024173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.027134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 895/1784] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:29 2022] DELETE /identity/v3/projects/bb37b1c4a1004ef28918c34c05ce9206 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:30.028902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:30.037034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:30.125802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:30.210219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405b43-2f21-483a-8744-c636f1ea484c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:30.225920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:30.226739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:30.228025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:30.228321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:30.230189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:30.236459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:30.237144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:30.237440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:30.237722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:30.245270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:30.368013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:30.416818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:30.421915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:30.461078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 890/1785] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:30.462323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:30.468622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:30.543538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab389-ef9f-498f-805c-9fac7f85c778 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:30.571281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:30.572791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae57e-f7f9-49fa-acbf-941a586f5c6e service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:30.581516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:30.583096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:30.594800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:30.595695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] PATH_INFO: `/v3/users/4621f86046bd4305b1035a0735f42074` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:30.598903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4621f86046bd4305b1035a0735f42074)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:30.601711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:30.639186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 896/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:30.641312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:30.641614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:30.641903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:30.800745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4621f86046bd4305b1035a0735f42074'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.801766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4621f86046bd4305b1035a0735f42074'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.815675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:30.817279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:30.818232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4621f86046bd4305b1035a0735f42074'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.819984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4621f86046bd4305b1035a0735f42074'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.834555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4621f86046bd4305b1035a0735f42074'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:30.875992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 891/1787] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:30 2022] DELETE /identity/v3/users/4621f86046bd4305b1035a0735f42074 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:31.008859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 897/1788] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:31.272430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:31.274050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:31.436986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:31.439044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:31.475776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36a6d-c694-4a04-a24f-85d2434c6d2e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:31.478551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef596e8-7af7-4ac6-bb44-4d47036472ce None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:31.486019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:31.487538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:31.487894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:31.488190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:31.566544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:31.666960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:31.674257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:31.687439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:31.715661 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 892/1789] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:45:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:45:31.743132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c19f8ac7a49df82a96846215b3472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bed4587564d4e3caf19de7239c2c6a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:31.748439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:31.755199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:31.755555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:31.756385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:31.759156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:31.764957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:31.814351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:31.827340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 898/1790] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:31.828402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ddaf-187d-4946-936c-a7f3a2d2da44 service swift] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:31.845334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c19f8ac7a49df82a96846215b3472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bed4587564d4e3caf19de7239c2c6a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:31.846991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:31.847528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:31.848182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:31.849693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:31.852497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:31.970573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:31.973176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 893/1791] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:31 2022] POST /identity/v3/projects => generated 354 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:31.996491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8ca9-754c-4d47-8943-bfdcfba31128 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:32.305545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c19f8ac7a49df82a96846215b3472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bed4587564d4e3caf19de7239c2c6a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:32.306641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:32.307340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:32.308404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:32.309157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:32.309472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:32.319778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:32.368202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 899/1792] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:32.506098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:32.529183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5812f2-9db8-4dd3-86d2-a0414dccbac8 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:32.559890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c19f8ac7a49df82a96846215b3472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bed4587564d4e3caf19de7239c2c6a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:32.565658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:32.566514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:32.566815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] PATH_INFO: `/v3/projects/5741270159a043d29de50994f2fc0d93` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:32.575449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5741270159a043d29de50994f2fc0d93)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:32.580729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:32.750351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5741270159a043d29de50994f2fc0d93', 'request_id': 'req-3b94b086-1c7f-434a-8e2f-4316d5608b25'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:32.770902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5741270159a043d29de50994f2fc0d93', 'request_id': 'req-3b94b086-1c7f-434a-8e2f-4316d5608b25'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:32.782694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5741270159a043d29de50994f2fc0d93', 'request_id': 'req-3b94b086-1c7f-434a-8e2f-4316d5608b25'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:32.811201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] The token cache is being invalidate because project 5741270159a043d29de50994f2fc0d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:32.811994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:32.812926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:32.814803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 894/1793] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:32 2022] DELETE /identity/v3/projects/5741270159a043d29de50994f2fc0d93 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:33.433278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:33.435948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:33.596733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c8315-13ff-44eb-b19b-f08710483462 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:33.711053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:33.712303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:33.712840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:33.713312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] PATH_INFO: `/v3/users/f6afa3e8d01648c6b5b42a312a811b08` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:33.715242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6afa3e8d01648c6b5b42a312a811b08)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:33.737578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:33.825686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:33.888378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6afa3e8d01648c6b5b42a312a811b08'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:33.920348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6afa3e8d01648c6b5b42a312a811b08'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:33.924150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6afa3e8d01648c6b5b42a312a811b08'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:33.924848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6afa3e8d01648c6b5b42a312a811b08'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:33.939844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57c03b79-2097-4e3b-a761-8fab34566317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6afa3e8d01648c6b5b42a312a811b08'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:33.950339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:33.952391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:33.979206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 900/1794] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:33 2022] DELETE /identity/v3/users/f6afa3e8d01648c6b5b42a312a811b08 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:34.018533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b086-1c7f-434a-8e2f-4316d5608b25 tempest-VolumeQuotaClassesTest-1825894588 tempest-VolumeQuotaClassesTest-1825894588-project-admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:34.022014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.022335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.030872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.090501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:34.096080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.258491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 901/1795] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:34.259791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:34.261017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.261559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.262146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] PATH_INFO: `/v3/projects/22bea8aad72e43ea92e73e6db63795dd` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.262664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:34.264639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.264837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bea8aad72e43ea92e73e6db63795dd)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:34.268647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:34.284422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce06e-3b9c-451c-83ee-49693195c70d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:34.292546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:34.293444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.293730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.294014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] PATH_INFO: `/v3/projects/5645b6b3cef342edad1e9936afb69dc7` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.297962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5645b6b3cef342edad1e9936afb69dc7)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:34.302565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:34.389901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:34.401678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bea8aad72e43ea92e73e6db63795dd', 'request_id': 'req-3444076d-708a-4d30-b798-b895517838e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.416429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bea8aad72e43ea92e73e6db63795dd', 'request_id': 'req-3444076d-708a-4d30-b798-b895517838e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.428460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5645b6b3cef342edad1e9936afb69dc7', 'request_id': 'req-98f458e0-c538-4d17-8428-55e82c14c105'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.433270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bea8aad72e43ea92e73e6db63795dd', 'request_id': 'req-3444076d-708a-4d30-b798-b895517838e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.445683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5645b6b3cef342edad1e9936afb69dc7', 'request_id': 'req-98f458e0-c538-4d17-8428-55e82c14c105'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.476037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] The token cache is being invalidate because project 22bea8aad72e43ea92e73e6db63795dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:34.476342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.477216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5645b6b3cef342edad1e9936afb69dc7', 'request_id': 'req-98f458e0-c538-4d17-8428-55e82c14c105'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.479332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.487860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 895/1796] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:33 2022] DELETE /identity/v3/projects/22bea8aad72e43ea92e73e6db63795dd => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:34.488848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:34.491314 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.506236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] The token cache is being invalidate because project 5645b6b3cef342edad1e9936afb69dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:34.506571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.507705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98f458e0-c538-4d17-8428-55e82c14c105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.511593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 902/1797] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:34 2022] DELETE /identity/v3/projects/5645b6b3cef342edad1e9936afb69dc7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:34.515449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.515790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.516079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.565090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:34.569688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.619243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:34.646079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444076d-708a-4d30-b798-b895517838e5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:34.652305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:34.653063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.653348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.653627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.660169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.719444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 903/1798] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:34.723709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:34.725431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.751556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4725-5a43-45eb-bb1f-ed4796fcf8c7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:34.763649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:34.765610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.765873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.766156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] PATH_INFO: `/v3/users/e85d25e49e8c4fc7b9b4c98e192a258e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.767639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85d25e49e8c4fc7b9b4c98e192a258e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:34.770747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:34.859289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:34.860766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c32f9-664c-4a71-b056-8014b5e2fa1e service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:34.875150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 896/1799] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:34.877227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.877919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.878425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.882263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85d25e49e8c4fc7b9b4c98e192a258e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.899105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:34.900262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.907557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85d25e49e8c4fc7b9b4c98e192a258e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.908931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85d25e49e8c4fc7b9b4c98e192a258e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.911032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85d25e49e8c4fc7b9b4c98e192a258e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.913703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 897/1800] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:34.914964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:34.922563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85d25e49e8c4fc7b9b4c98e192a258e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:34.926794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b1b47-032d-4250-9d69-0d7de2a2c340 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:34.934989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:34.935687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.935988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.936594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.938161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:34.938974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:34.940632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:34.952131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 904/1801] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:34 2022] DELETE /identity/v3/users/e85d25e49e8c4fc7b9b4c98e192a258e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:34.975980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 898/1802] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:34.977288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:34.981455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:35.206318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9f65f-4cbc-4fdb-afe2-9f95971f5006 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:35.232518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:35.234145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:35.236611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:35.251162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:35.254706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:35.273704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:35.361689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 905/1803] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:34 2022] POST /identity/v3/projects => generated 381 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:35.368579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:35.411855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2ab20-ddc4-40f0-ae2d-164ac58e3173 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:35.633901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:35.643343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:35.644127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:35.644417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:35.644946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:35.647564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:35.649917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:35.705113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:35.727926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39c316-d6c8-46fe-ac56-6950a6f4214b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:35.731995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 899/1804] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:35 2022] POST /identity/v3/users => generated 291 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:35.752533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:35.753832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:35.753832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:35.753832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:35.754637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:35.762702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:35.818563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 906/1805] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:35.826325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:35.887076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a9e62-ddde-4327-82d5-ee38f33d2879 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:35.907276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e14a1-69e6-4e92-8a16-9af9b85b2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:35.925343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e14a1-69e6-4e92-8a16-9af9b85b2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:35.925930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e14a1-69e6-4e92-8a16-9af9b85b2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:35.926321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e14a1-69e6-4e92-8a16-9af9b85b2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:35.927282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e14a1-69e6-4e92-8a16-9af9b85b2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:35.932276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e14a1-69e6-4e92-8a16-9af9b85b2be0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:35.989683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 900/1806] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:35.996792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:36.019111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d1076-09cb-480e-86b8-20ac3f7f154c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:36.056207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:36.057269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:36.057560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:36.058536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] PATH_INFO: `/v3/projects/9f6a66f6b712429082658cd521b49389/users/c841acdd9f3b4a7e9bf512953b5e6e58/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:36.122215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:36.138837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6a66f6b712429082658cd521b49389, user_id=c841acdd9f3b4a7e9bf512953b5e6e58, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:36.149426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:36.194816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 907/1807] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:35 2022] PUT /identity/v3/projects/9f6a66f6b712429082658cd521b49389/users/c841acdd9f3b4a7e9bf512953b5e6e58/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:36.209600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe2e0-a068-4021-9d5a-f51bed756863 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:36.211258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe2e0-a068-4021-9d5a-f51bed756863 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:36.211585 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe2e0-a068-4021-9d5a-f51bed756863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:36.269184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:36.272298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:36.332117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-35efe2e0-a068-4021-9d5a-f51bed756863 None None] MFA Rules not processed for user `c841acdd9f3b4a7e9bf512953b5e6e58`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:36.333595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-35efe2e0-a068-4021-9d5a-f51bed756863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:36.498832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e57dc1-a13f-4f15-8889-5e0b40221163 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:36.513528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:36.516091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:36.516674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:36.518603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] PATH_INFO: `/v3/projects/1006afc262904f55a5695ed9a9907266` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:36.522886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1006afc262904f55a5695ed9a9907266)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:36.525770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:36.583869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 901/1808] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:36.585410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:36.588045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:36.588462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:36.678780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:36.690830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:36.692669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1006afc262904f55a5695ed9a9907266', 'request_id': 'req-81dcc88a-d487-4420-aad2-eec044900054'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:36.712939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1006afc262904f55a5695ed9a9907266', 'request_id': 'req-81dcc88a-d487-4420-aad2-eec044900054'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:36.731214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1006afc262904f55a5695ed9a9907266', 'request_id': 'req-81dcc88a-d487-4420-aad2-eec044900054'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:36.775963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] The token cache is being invalidate because project 1006afc262904f55a5695ed9a9907266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:36.776964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:36.781065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:36.791480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 908/1809] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:36 2022] DELETE /identity/v3/projects/1006afc262904f55a5695ed9a9907266 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:36.793474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:36.801316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:36.871787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 902/1810] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 19 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:36.872716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:36.882456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:36.942839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcc88a-d487-4420-aad2-eec044900054 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:36.950641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:36.951517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:36.954468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:36.955257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:36.956440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:36.959038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.047545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 909/1811] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:36 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:37.049872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:37.058253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:37.090663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:37.132717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e61426-d81d-46eb-a9b7-6677a1321ff4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.176776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:37.200571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e02b5-73ae-4c2d-a93d-562210b72aa8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.226587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:37.228550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:37.228878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:37.230555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:37.252814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:37.256269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.262430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:37.263387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:37.263679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:37.264007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] PATH_INFO: `/v3/users/827c19f8ac7a49df82a96846215b3472` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:37.267680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827c19f8ac7a49df82a96846215b3472)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:37.274876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.276288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 910/1812] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:37.278881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:37.300579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0ddf0-c862-4ba3-95e1-e228c78f53bd service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.309148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:37.309948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:37.310245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:37.314118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:37.333199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:37.334867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.357738 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 911/1813] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:37.361451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:37.365771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:37.432202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34de6-8e48-4afa-a2d9-34606016d795 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.446802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827c19f8ac7a49df82a96846215b3472'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.447566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827c19f8ac7a49df82a96846215b3472'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.472823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827c19f8ac7a49df82a96846215b3472'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.473490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:37.473633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827c19f8ac7a49df82a96846215b3472'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.474470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:37.474728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:37.475015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] PATH_INFO: `/v3/projects/f66dd676c4a342f4bf4a0ef8cfe9612e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:37.485362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66dd676c4a342f4bf4a0ef8cfe9612e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:37.490055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827c19f8ac7a49df82a96846215b3472'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.494950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.568327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 903/1814] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:36 2022] DELETE /identity/v3/users/827c19f8ac7a49df82a96846215b3472 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:37.569609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:37.574225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:37.614094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66dd676c4a342f4bf4a0ef8cfe9612e', 'request_id': 'req-49f6a83f-ad0f-4073-8d02-b03a9966e517'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.621968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66dd676c4a342f4bf4a0ef8cfe9612e', 'request_id': 'req-49f6a83f-ad0f-4073-8d02-b03a9966e517'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.640170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66dd676c4a342f4bf4a0ef8cfe9612e', 'request_id': 'req-49f6a83f-ad0f-4073-8d02-b03a9966e517'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.668746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] The token cache is being invalidate because project f66dd676c4a342f4bf4a0ef8cfe9612e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:37.671254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.672647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:37.680483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 912/1815] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:37 2022] DELETE /identity/v3/projects/f66dd676c4a342f4bf4a0ef8cfe9612e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:37.682040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:37.686927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:37.768161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fdbb1-d2af-44db-9471-87083247d6e8 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.833438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:37.859052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:37.859859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:37.860458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:37.860681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:37.861435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:37.865414 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.880024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a83f-ad0f-4073-8d02-b03a9966e517 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.914222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:37.915395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:37.916047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:37.916562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:37.919473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:37.925446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 904/1816] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:37 2022] POST /identity/v3/users => generated 297 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:37.926218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:37.956519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:37.963773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:37.967300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53800f58-b0dd-4cdf-8b02-f8bed4157790 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:37.993142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f6e4-0d67-4d06-a5f5-28558412b09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.001112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f6e4-0d67-4d06-a5f5-28558412b09f service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.001683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f6e4-0d67-4d06-a5f5-28558412b09f service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.002761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f6e4-0d67-4d06-a5f5-28558412b09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.013348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 913/1817] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:38.013348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.023718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:38.027653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56f6e4-0d67-4d06-a5f5-28558412b09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.031806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56f6e4-0d67-4d06-a5f5-28558412b09f service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.050243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 905/1818] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:38.051624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b6e33-9277-4681-a8a7-dd19d1caf528 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.051917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b6e33-9277-4681-a8a7-dd19d1caf528 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.052198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b6e33-9277-4681-a8a7-dd19d1caf528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.057652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e488a9-9e16-4f55-a8c6-9fa3a1249772 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.071573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.072348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.074079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.074509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.095633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.097333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.104223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-8b4b6e33-9277-4681-a8a7-dd19d1caf528 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:38.107046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8b4b6e33-9277-4681-a8a7-dd19d1caf528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:38.143528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 914/1819] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:38.146105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 906/1820] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:38.152505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.157769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.158153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.158518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.159008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:38.195810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db764b74-f9de-4b2d-aa26-27b7fd7ce3f8 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.220202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.225205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.227167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.227563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.233337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.235359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.240153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:38.258038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 915/1821] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:38.262473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.266039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:38.272599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:38.285038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83fa7f-8f66-4e75-affc-920717ddf22f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.294972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.296017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.296265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.296547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] PATH_INFO: `/v3/projects/5bea7b52ce3845edaee0a4e09c3430aa/users/a38ec73422574611b59303ad07497da3/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.316606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 907/1822] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:38.322544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.332880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bea7b52ce3845edaee0a4e09c3430aa, user_id=a38ec73422574611b59303ad07497da3, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.335543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.362740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 916/1823] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:38 2022] PUT /identity/v3/projects/5bea7b52ce3845edaee0a4e09c3430aa/users/a38ec73422574611b59303ad07497da3/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:38.363826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ddcbe-c86d-4f6d-b4cd-47ac16464d5b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.366673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.509129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.509944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.510618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.511386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.512492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:38.512936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.514844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.535574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 908/1824] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:38.536660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.542266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7e80-4216-4d82-8b06-3b31f0d8c306 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.559942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.560369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c686fe-23de-48d6-b85e-b5a9b8b17809 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.560642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.561472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.561750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.562543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.564422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.577656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.579367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.579748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.580136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.584194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.590343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.606998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 917/1825] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:38.610503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.638345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096a51-8ffe-4363-bdfa-c86e6e0c4ecf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.658627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94717318-2a69-4969-9bf9-6b5649e5d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:38.660143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94717318-2a69-4969-9bf9-6b5649e5d280 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.660554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94717318-2a69-4969-9bf9-6b5649e5d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.661574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94717318-2a69-4969-9bf9-6b5649e5d280 admin admin] PATH_INFO: `/v3/projects/5bea7b52ce3845edaee0a4e09c3430aa/users/a38ec73422574611b59303ad07497da3/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.670134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94717318-2a69-4969-9bf9-6b5649e5d280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bea7b52ce3845edaee0a4e09c3430aa, user_id=a38ec73422574611b59303ad07497da3, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:38.680012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94717318-2a69-4969-9bf9-6b5649e5d280 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:38.685508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 909/1826] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:38 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:38.686801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:38.726625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 918/1827] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:38 2022] PUT /identity/v3/projects/5bea7b52ce3845edaee0a4e09c3430aa/users/a38ec73422574611b59303ad07497da3/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:38.731994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.732466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.733579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.821546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] MFA Rules not processed for user `a38ec73422574611b59303ad07497da3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:38.823652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:38.875102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a403c6-f721-4426-b1fd-e7aa3e4ad358 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:38.943084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:39.048851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.051026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.055291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 919/1828] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:39.056991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.057563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.058720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.064363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:39.074180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.074515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:39.133428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 910/1829] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:38 2022] POST /identity/v3/users => generated 305 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:39.137393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.161739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2150c9-f8f2-46b7-9b2c-3e73da2ecee8 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:39.172252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.173260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.173753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.174195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.177931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.191742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:39.208540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 911/1830] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:39.212677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.239499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555def26-5192-49c2-8c19-f0cc6776eaba admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:39.247924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.249601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.249961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.251336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:39.253527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.254610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.257813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:39.284984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 912/1831] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:39.289110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.296266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18cbb6-f650-441b-819e-fbb6f04af3c3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:39.318747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5613e-e7e7-4014-925d-7468facbf8a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.319438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5613e-e7e7-4014-925d-7468facbf8a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.319824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5613e-e7e7-4014-925d-7468facbf8a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.320113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5613e-e7e7-4014-925d-7468facbf8a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.323147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff5641-0d05-4fde-a164-33ea12a5adbd admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:39.332107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5613e-e7e7-4014-925d-7468facbf8a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.337179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5613e-e7e7-4014-925d-7468facbf8a2 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:39.339846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.340781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.344811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.345262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] PATH_INFO: `/v3/projects/d25b328168f04b36b0f3044beceeaaa3/users/326a4beeceb940318ab2111b42ca1aa8/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.363988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 920/1832] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:39.375505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25b328168f04b36b0f3044beceeaaa3, user_id=326a4beeceb940318ab2111b42ca1aa8, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.379277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:39.437573 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 913/1833] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:39 2022] PUT /identity/v3/projects/d25b328168f04b36b0f3044beceeaaa3/users/326a4beeceb940318ab2111b42ca1aa8/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:39.455420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.456209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.456209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.587834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] MFA Rules not processed for user `326a4beeceb940318ab2111b42ca1aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:39.587834 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:39.599767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.698506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a3888-3b14-448b-97de-d552457bee37 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:39.704540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.705873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.706176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.706558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.709949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:39.826210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.827544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:39.841120 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 914/1834] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:39.843039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.846783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:39.897589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 921/1835] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:39.899119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:39.904223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:39.954496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ac598-f284-4f5f-a1a1-40e7fbf6fea8 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:39.964838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:39.972791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:39.974842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:39.975157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] PATH_INFO: `/v3/projects/2bed4587564d4e3caf19de7239c2c6a2` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:39.978033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bed4587564d4e3caf19de7239c2c6a2)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:39.984167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:40.146695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bed4587564d4e3caf19de7239c2c6a2', 'request_id': 'req-e179b250-8ea2-41d1-86fa-84d3f81fb895'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:40.165181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bed4587564d4e3caf19de7239c2c6a2', 'request_id': 'req-e179b250-8ea2-41d1-86fa-84d3f81fb895'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:40.177769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bed4587564d4e3caf19de7239c2c6a2', 'request_id': 'req-e179b250-8ea2-41d1-86fa-84d3f81fb895'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:40.195712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fc101-ca3b-462e-a4c5-f0f773994f63 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:40.205559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] The token cache is being invalidate because project 2bed4587564d4e3caf19de7239c2c6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:40.207895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:40.211286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e179b250-8ea2-41d1-86fa-84d3f81fb895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:40.221564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 915/1836] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:39 2022] DELETE /identity/v3/projects/2bed4587564d4e3caf19de7239c2c6a2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:40.223280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa25da-ccae-48cc-b954-7d2f89c47acf None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.223578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa25da-ccae-48cc-b954-7d2f89c47acf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.223865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa25da-ccae-48cc-b954-7d2f89c47acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.275116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-51aa25da-ccae-48cc-b954-7d2f89c47acf None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:40.279990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-51aa25da-ccae-48cc-b954-7d2f89c47acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:40.392026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:40.393298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.396176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.396606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.397574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:40.405127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:40.463338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 916/1837] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:40.472267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.472584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.472871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.474199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 922/1838] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:39 2022] POST /identity/v3/projects => generated 407 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:40.476281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:40.480997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:40.496079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:40.522262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:40.523545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:40.740632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87c88-7c14-4826-a3fc-9813ba404c85 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:40.744278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:40.776614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:40.785125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 917/1839] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:40.786735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:40.787138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.787741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.789381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.790791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:40.798625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34e1b2-43b3-49ce-ad1b-f5a96f15b18c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:40.801063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:40.823742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:40.827687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.828173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.828523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.829402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:40.829777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:40.831903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:40.864182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 918/1840] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:40.866392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:40.881592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120623ca-55e9-4c92-ad52-830a13762046 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:40.890269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 923/1841] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:40 2022] POST /identity/v3/users => generated 310 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:40.893140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:40.900081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:40.901675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.903010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.905234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.907626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:40.909884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:40.939471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c015a-5bf2-4b30-a4c6-f4f4fdf578df admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:40.985214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:40.987231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:40.988469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:40.990082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:40.991593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:40.994782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:40.998536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 919/1842] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:40 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:40.999975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.050334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 924/1843] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:41.060105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.085127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7547-97ba-446b-945f-be6a21e76ebb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.219402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38eb9-bbf4-485f-b03f-b214e2043e40 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.234049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.235124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.238254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.238571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.239486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.247138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.295814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.298107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.298481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.298769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] PATH_INFO: `/v3/projects/9231799e634a455486fdebbb278da470/users/a47ae750a4764655861eb40bddafdc59/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.305651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 920/1844] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:40 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:41.307791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.331741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9231799e634a455486fdebbb278da470, user_id=a47ae750a4764655861eb40bddafdc59, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.334827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.335401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac86dc1-0738-4dcb-a49a-f1a34b362609 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.347183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.348473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.348768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.350970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.353627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.358778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.376618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 925/1845] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:41 2022] PUT /identity/v3/projects/9231799e634a455486fdebbb278da470/users/a47ae750a4764655861eb40bddafdc59/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:41.380623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.391249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 921/1846] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:41.396012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.422786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a7df2-e1f4-4290-8ed2-85dfd4b16cd6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.530899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.533314 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.533603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.533886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.534939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.536588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.564973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 922/1847] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:41.578806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.582956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24e31-f091-49cd-9ba6-d71237d5b8ab admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.588156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.588845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.589127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.589406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.590140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.607041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.607267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd9ef-e3f1-42c1-b634-c8cc4397ede7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.630826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5de43-97a1-4bda-9947-6a021737b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.630826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5de43-97a1-4bda-9947-6a021737b934 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.631569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5de43-97a1-4bda-9947-6a021737b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.632132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5de43-97a1-4bda-9947-6a021737b934 admin admin] PATH_INFO: `/v3/projects/e477d3b4f7ce481cb5e3d61b91e62506/users/3c16bc2259dd4565bd724eafbd50c8bd/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.641455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 926/1848] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:41.642735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:41.648518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:41.676745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729460-bd7c-4b56-b30f-fd751c028b0d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:41.695876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770fb82-5b72-40ae-b929-fcb107ed0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:41.697045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770fb82-5b72-40ae-b929-fcb107ed0546 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.697479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770fb82-5b72-40ae-b929-fcb107ed0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.697919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770fb82-5b72-40ae-b929-fcb107ed0546 admin admin] PATH_INFO: `/v3/projects/9231799e634a455486fdebbb278da470/users/a47ae750a4764655861eb40bddafdc59/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.699759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5de43-97a1-4bda-9947-6a021737b934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e477d3b4f7ce481cb5e3d61b91e62506, user_id=3c16bc2259dd4565bd724eafbd50c8bd, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.704531 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770fb82-5b72-40ae-b929-fcb107ed0546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9231799e634a455486fdebbb278da470, user_id=a47ae750a4764655861eb40bddafdc59, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:41.709100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770fb82-5b72-40ae-b929-fcb107ed0546 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.711059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5de43-97a1-4bda-9947-6a021737b934 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:41.752433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 923/1849] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:41 2022] PUT /identity/v3/projects/e477d3b4f7ce481cb5e3d61b91e62506/users/3c16bc2259dd4565bd724eafbd50c8bd/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:41.768434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.768870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.769028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.782190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 927/1850] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:41 2022] PUT /identity/v3/projects/9231799e634a455486fdebbb278da470/users/a47ae750a4764655861eb40bddafdc59/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:41.795785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:41.796308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:41.796846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:41.855372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] MFA Rules not processed for user `3c16bc2259dd4565bd724eafbd50c8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:41.855779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] MFA Rules not processed for user `a47ae750a4764655861eb40bddafdc59`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:41.856614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:41.858733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:41.871949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:42.006146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 928/1851] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:42.020574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.022924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:42.083645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 924/1852] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:42.084946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.230020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b3c-18c7-45f6-9077-db59634852d5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:42.247092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:42.248168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:42.249143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:42.249717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:42.262347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:42.270502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:42.280373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63ac95-16ed-412b-823c-7cff6bf38596 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:42.291525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 929/1853] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:42.293088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:42.294092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:42.294583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:42.295030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:42.295969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:42.299631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:42.351522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 925/1854] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:42 2022] POST /identity/v3/projects => generated 391 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:42.357247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.372647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfa05-c6cb-4d71-a178-321c19c139a9 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:42.586614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:42.587541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:42.587955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:42.588352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:42.589240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:42.591493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:42.635739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 930/1855] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:42 2022] POST /identity/v3/users => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:42.644323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.665307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.684920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e6738-e763-4486-a68c-67a13c2c9a2b admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:42.693190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:42.693998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:42.694297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:42.694604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:42.695459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:42.697243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:42.717355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 926/1856] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:42.719514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:42.721124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.750096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebe3c1-29b3-4307-bac0-520661efe46d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:42.759755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:42.761564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:42.762240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:42.762679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] PATH_INFO: `/v3/projects/59d88706e09349a691286201d2b23b14/users/9b717dcebb4347b2b317c367adaa4ec9/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:42.791358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d88706e09349a691286201d2b23b14, user_id=9b717dcebb4347b2b317c367adaa4ec9, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:42.796949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:42.837650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 927/1857] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:42 2022] PUT /identity/v3/projects/59d88706e09349a691286201d2b23b14/users/9b717dcebb4347b2b317c367adaa4ec9/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:42.839269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:42.898844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e06c-1b6a-4727-b0e4-f9a1f0551d79 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:42.985089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:42.994288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621cf8-63ea-49ed-8a14-55baf28e9fc3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:43.022297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:43.023309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:43.023747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:43.024176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:43.025253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:43.028025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:43.063807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 928/1858] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:43.075650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:43.110180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b948c-ba23-4ef9-9761-44b9f0dde8aa admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:43.131594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9402a7c-7524-440c-9128-bdfb5383034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:43.131594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402a7c-7524-440c-9128-bdfb5383034b admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:43.131594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402a7c-7524-440c-9128-bdfb5383034b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:43.131594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402a7c-7524-440c-9128-bdfb5383034b admin admin] PATH_INFO: `/v3/projects/59d88706e09349a691286201d2b23b14/users/9b717dcebb4347b2b317c367adaa4ec9/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:43.136474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9402a7c-7524-440c-9128-bdfb5383034b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d88706e09349a691286201d2b23b14, user_id=9b717dcebb4347b2b317c367adaa4ec9, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:43.142685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9402a7c-7524-440c-9128-bdfb5383034b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:43.158843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:43.160005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:43.160181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:43.160568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:43.174906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:43.206325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 929/1859] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:43 2022] PUT /identity/v3/projects/59d88706e09349a691286201d2b23b14/users/9b717dcebb4347b2b317c367adaa4ec9/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:43.208620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:43.208894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:43.209395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:43.316758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] MFA Rules not processed for user `9b717dcebb4347b2b317c367adaa4ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:43.331759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:43.338950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:43.342265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621ea7d-c436-452d-8821-8353560c7231 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:43.372486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 931/1860] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:43.376988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5279e4-f057-4ecf-b0fb-7d74e23ea5f3 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:43.378238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5279e4-f057-4ecf-b0fb-7d74e23ea5f3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:43.379076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5279e4-f057-4ecf-b0fb-7d74e23ea5f3 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:43.383324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 932/1861] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:45:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:43.552483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 930/1862] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:43.761077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492a77-9b57-482e-8410-aff978a76222 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:43.761381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492a77-9b57-482e-8410-aff978a76222 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:43.761649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492a77-9b57-482e-8410-aff978a76222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:43.787896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:43.790234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:43.808706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0d492a77-9b57-482e-8410-aff978a76222 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:43.814158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0d492a77-9b57-482e-8410-aff978a76222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:44.032655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4166d-f0af-49d2-ba5d-6a115e84600e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:44.055556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:44.056520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:44.065174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:44.065474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:44.120164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 933/1863] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:44.128759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81329c7d-c3c7-4449-bc0a-2da3381155fa None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:44.129056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81329c7d-c3c7-4449-bc0a-2da3381155fa None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:44.132793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81329c7d-c3c7-4449-bc0a-2da3381155fa None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:44.140197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 934/1864] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:45:44 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:44.148582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:44.153372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:44.175448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 931/1865] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:44.275187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:44.275864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:44.276252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:44.348299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:44.355594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:44.403098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:44.408989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 935/1866] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:45:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:44.425051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79331969-9eb9-45ee-b89b-478d5d45850f service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:44.441332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338b46d-08fc-4728-b8ea-291792d60e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:44.442234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338b46d-08fc-4728-b8ea-291792d60e08 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:44.442729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338b46d-08fc-4728-b8ea-291792d60e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:44.445240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338b46d-08fc-4728-b8ea-291792d60e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:44.668520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338b46d-08fc-4728-b8ea-291792d60e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:44.671988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338b46d-08fc-4728-b8ea-291792d60e08 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:44.698462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:44.707169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:44.707699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 932/1867] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:44.723935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:45.003445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a43a5-13ba-402e-855d-dd610a3f2045 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:45.025980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:45.027965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:45.028296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:45.028858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] PATH_INFO: `/v3/users/c841acdd9f3b4a7e9bf512953b5e6e58` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:45.031835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c841acdd9f3b4a7e9bf512953b5e6e58)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:45.037401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:45.163784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c841acdd9f3b4a7e9bf512953b5e6e58'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:45.197345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c841acdd9f3b4a7e9bf512953b5e6e58'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:45.199357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c841acdd9f3b4a7e9bf512953b5e6e58'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:45.203007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c841acdd9f3b4a7e9bf512953b5e6e58'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:45.236406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c841acdd9f3b4a7e9bf512953b5e6e58'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:45.258911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 936/1868] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:44 2022] DELETE /identity/v3/users/c841acdd9f3b4a7e9bf512953b5e6e58 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:45.263561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:45.264552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:45.265325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:45.274234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:45.281914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:45.283729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:45.332657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:45.335354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:45.440944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbd8e8-6342-48fb-aa27-dfcce06d8abf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:45.462403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:45.463093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:45.463386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:45.463668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:45.469968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:45.511526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:45.515051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:45.560215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 937/1869] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:45.586657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 933/1870] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:45.693690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:45.696665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:45.722246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:45.753689 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:45.777502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f8e-2bf5-4347-977a-b5f009c3cfb5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:45.785533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:45.787324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:45.787324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:45.787567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:45.789408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:45.831113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:45.835532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:45.891274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 934/1871] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:45.914514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051f92-f495-4180-94a0-d56cf1ebf5d6 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:45.931621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:45.932527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:45.935117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:45.935672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:45.963560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:45.966134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:45.985376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 938/1872] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:46.792224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:46.799709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:46.816637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0a420-732b-4b84-bb39-21aeaac4254d service nova] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:46.829925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:46.830837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:46.831123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:46.831403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] PATH_INFO: `/v3/projects/9f6a66f6b712429082658cd521b49389` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:46.832606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6a66f6b712429082658cd521b49389)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:46.834566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:46.889398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6a66f6b712429082658cd521b49389', 'request_id': 'req-d0d3d432-80b9-4f55-afb5-70db53f606f5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:46.898334 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6a66f6b712429082658cd521b49389', 'request_id': 'req-d0d3d432-80b9-4f55-afb5-70db53f606f5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:46.905975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6a66f6b712429082658cd521b49389', 'request_id': 'req-d0d3d432-80b9-4f55-afb5-70db53f606f5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:46.921110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] The token cache is being invalidate because project 9f6a66f6b712429082658cd521b49389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:46.921409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:46.922066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:46.927169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 935/1873] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:46 2022] DELETE /identity/v3/projects/9f6a66f6b712429082658cd521b49389 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:46.928927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:46.939196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a9cc8-212c-4490-97f3-4ae685286c81 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.021083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.022110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.022550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.022909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] PATH_INFO: `/v3/users/a38ec73422574611b59303ad07497da3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.024105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38ec73422574611b59303ad07497da3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.026043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.076372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38ec73422574611b59303ad07497da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.088897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38ec73422574611b59303ad07497da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.089782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38ec73422574611b59303ad07497da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.090498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38ec73422574611b59303ad07497da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.098035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ab4bb9e1-5729-4e32-9cb3-f0da6c5346f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38ec73422574611b59303ad07497da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.115549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 939/1874] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:46 2022] DELETE /identity/v3/users/a38ec73422574611b59303ad07497da3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:47.405482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:47.406963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:47.421736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d432-80b9-4f55-afb5-70db53f606f5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.479203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.480021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.480311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.480594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] PATH_INFO: `/v3/projects/5bea7b52ce3845edaee0a4e09c3430aa` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.481791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bea7b52ce3845edaee0a4e09c3430aa)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.483753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.500505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:47.531612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bea7b52ce3845edaee0a4e09c3430aa', 'request_id': 'req-a54a130a-4f47-43af-9d3c-953644091e83'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.541204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bea7b52ce3845edaee0a4e09c3430aa', 'request_id': 'req-a54a130a-4f47-43af-9d3c-953644091e83'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.548978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bea7b52ce3845edaee0a4e09c3430aa', 'request_id': 'req-a54a130a-4f47-43af-9d3c-953644091e83'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.562235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] The token cache is being invalidate because project 5bea7b52ce3845edaee0a4e09c3430aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:47.562570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.563256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a54a130a-4f47-43af-9d3c-953644091e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:47.565129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 936/1875] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:47 2022] DELETE /identity/v3/projects/5bea7b52ce3845edaee0a4e09c3430aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:47.569770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.570069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.570345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.591213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:47.592492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:47.617777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:47.657252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 940/1876] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:47.665397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.665697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.665985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.703906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:47.705283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:47.713634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 937/1877] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:47.717960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:47.727814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3e58-6374-46ea-b307-15cf2d19aa31 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.732519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.733669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.734039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.734237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.735004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:47.735317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.736962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.752780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 941/1878] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:47.753950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:47.763565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364b67-9f2d-449d-9b06-c81aa0cda3ca None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.770219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.771049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.771346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.771694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.772478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.774537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.810040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 938/1879] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:47 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:47.811355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:47.822785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e57c7-b699-4b9b-a7f8-b0743f2c928a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.893373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.894054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.894344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.894657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.895370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.897629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.918954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 942/1880] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:47 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:47.923442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:47.934187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26708-8af2-49e5-b8e3-680a2308ce50 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.939288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.939963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.940255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.940569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.941466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.943274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.955118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 939/1881] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:47.959092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:47.970427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789497aa-7133-4b40-9212-eebd58c1051b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:47.976090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbf618-8259-43e0-8019-8834e767b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:47.976783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf618-8259-43e0-8019-8834e767b4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:47.977092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf618-8259-43e0-8019-8834e767b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:47.977392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf618-8259-43e0-8019-8834e767b4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:47.978157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbf618-8259-43e0-8019-8834e767b4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:47.979818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbf618-8259-43e0-8019-8834e767b4c4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:47.994522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 943/1882] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:47.995571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.007158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279cfd9-2d07-495f-9737-69cb67299892 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.012122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.013047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.013343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.013630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] PATH_INFO: `/v3/projects/a3ba84cfbee54d8b9e7274c4f9d69318/users/b700a70b7efc40709486d89e6cdfd226/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.030877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ba84cfbee54d8b9e7274c4f9d69318, user_id=b700a70b7efc40709486d89e6cdfd226, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.033566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.053046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 940/1883] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:47 2022] PUT /identity/v3/projects/a3ba84cfbee54d8b9e7274c4f9d69318/users/b700a70b7efc40709486d89e6cdfd226/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:48.064830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.065173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.066571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.098621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] MFA Rules not processed for user `b700a70b7efc40709486d89e6cdfd226`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:48.100108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:48.192355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 944/1884] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:48.192588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.260025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ea07-0191-4347-b871-c4bbb7ee6300 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.264904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.265568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.265856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.266142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.266873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.268773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.293924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 941/1885] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:48 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:48.298681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.309186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0b1ab-bc7c-44f2-8dca-d36d5224902f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.330978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:48.372962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.373931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.374409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.374702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.375408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.377324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.396734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 945/1886] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:48 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:48.400717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.415970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73ab87-50d1-48f8-bddc-212917459f00 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.420939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.421604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.421921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.422205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.422971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.424567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.435329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 942/1887] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:48.439427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.449529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688cb1-d618-4693-94c3-34917f8e1e71 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.455271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4898a2b-6230-4570-891c-a68a9e14cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.455939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4898a2b-6230-4570-891c-a68a9e14cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.456230 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4898a2b-6230-4570-891c-a68a9e14cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.456513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4898a2b-6230-4570-891c-a68a9e14cc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.457248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4898a2b-6230-4570-891c-a68a9e14cc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.458891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4898a2b-6230-4570-891c-a68a9e14cc30 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.472584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 946/1888] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:48.474548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.485904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd007b8-ffcd-4498-8e12-c5428351e5ff admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.490995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.492012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.492372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.492729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] PATH_INFO: `/v3/projects/0cbe3c6db25043a7826f3743a7935f45/users/4b8fa55051054899b3f65b587afc93ce/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.507538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:48.511220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbe3c6db25043a7826f3743a7935f45, user_id=4b8fa55051054899b3f65b587afc93ce, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.515116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.532049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 943/1889] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:48 2022] PUT /identity/v3/projects/0cbe3c6db25043a7826f3743a7935f45/users/4b8fa55051054899b3f65b587afc93ce/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:48.543056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.543352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.543657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.572937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] MFA Rules not processed for user `4b8fa55051054899b3f65b587afc93ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:48.574187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:48.647668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 947/1890] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:48.652192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.718950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaff95-b701-4df2-ae21-d9c6e70d87b2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.726973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.727652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.727937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.728217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.728923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.730913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.757513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 944/1891] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:48 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:48.761559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.773082 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f51f2c-c709-458b-aa69-a3fa9af076e7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.832910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.833683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.834045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.834334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.835068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.836988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.860707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 948/1892] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:48 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:48.862271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.883215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664ae2e-144f-47be-8972-3e82fda4a0b4 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.888082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.888755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.889162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.890144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.891014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.894117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.906004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 945/1893] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:48.910489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.920652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e95ea-84fb-40cc-8d9c-81bd5e40e0d8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:48.925271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:48.926250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:48.926573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:48.926860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] PATH_INFO: `/v3/projects/c0395bbb0c124126b1e391e726a1afd1/users/784e5e80424941c193b3f174f6af9e7d/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:48.942699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0395bbb0c124126b1e391e726a1afd1, user_id=784e5e80424941c193b3f174f6af9e7d, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:48.945365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:48.954013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:48.963041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 949/1894] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:48 2022] PUT /identity/v3/projects/c0395bbb0c124126b1e391e726a1afd1/users/784e5e80424941c193b3f174f6af9e7d/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:48.964241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:48.974802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f38bd-2b31-4536-b0c9-77b816295467 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:49.032075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede45613-04b3-47d2-bcc5-981b6c64ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:49.032746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede45613-04b3-47d2-bcc5-981b6c64ed16 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:49.033028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede45613-04b3-47d2-bcc5-981b6c64ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:49.033306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede45613-04b3-47d2-bcc5-981b6c64ed16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:49.034028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede45613-04b3-47d2-bcc5-981b6c64ed16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:49.035902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede45613-04b3-47d2-bcc5-981b6c64ed16 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:49.048369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 946/1895] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:49.050689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:49.061463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcde69-8b7d-4ddc-990a-4558a3f5dee0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:49.066115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:49.067022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:49.067315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:49.067597 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] PATH_INFO: `/v3/projects/c0395bbb0c124126b1e391e726a1afd1/users/784e5e80424941c193b3f174f6af9e7d/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:49.069577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0395bbb0c124126b1e391e726a1afd1, user_id=784e5e80424941c193b3f174f6af9e7d, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:49.072260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:49.083064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 950/1896] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:49 2022] PUT /identity/v3/projects/c0395bbb0c124126b1e391e726a1afd1/users/784e5e80424941c193b3f174f6af9e7d/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:49.094068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:49.094379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:49.094687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:49.121327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] MFA Rules not processed for user `784e5e80424941c193b3f174f6af9e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:49.122567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:49.171954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:49.196138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 947/1897] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:49.207527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:49.209467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:49.282527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e026-de24-4bce-83e1-d42128e5f324 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:49.286870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:49.287524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:49.288058 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:49.288343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:49.299445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:49.300910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:49.312118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 951/1898] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:49.363489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:49.364900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:49.386336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb5de-1fcb-4608-be6c-20f45ccfef19 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:49.390980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d312ce-f8f9-47a1-bf26-be337488876d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:49.391663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d312ce-f8f9-47a1-bf26-be337488876d service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:49.391951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d312ce-f8f9-47a1-bf26-be337488876d service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:49.403407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d312ce-f8f9-47a1-bf26-be337488876d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:49.495782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d312ce-f8f9-47a1-bf26-be337488876d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:49.497806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d312ce-f8f9-47a1-bf26-be337488876d service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:49.508886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 948/1899] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:50.674407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:50.677359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:50.748224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aee70-4dfa-4a85-899e-0da816de5b9e service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:50.752810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:50.753687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:50.753970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:50.754247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] PATH_INFO: `/v3/users/3c16bc2259dd4565bd724eafbd50c8bd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:50.755489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c16bc2259dd4565bd724eafbd50c8bd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:50.757804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:50.807958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c16bc2259dd4565bd724eafbd50c8bd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:50.824001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c16bc2259dd4565bd724eafbd50c8bd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:50.824642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c16bc2259dd4565bd724eafbd50c8bd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:50.825256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c16bc2259dd4565bd724eafbd50c8bd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:50.833587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c16bc2259dd4565bd724eafbd50c8bd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:50.846999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 952/1900] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:50 2022] DELETE /identity/v3/users/3c16bc2259dd4565bd724eafbd50c8bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:50.851557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:50.852461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:50.852968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:50.877610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:50.878887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:50.895162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:50.896581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:50.907842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:50.946404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 949/1901] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:50.953716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:50.955115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:50.976970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa240f2-1557-4f2c-a42b-273fd20beae4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:50.982061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:50.983529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:50.983844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:50.984128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] PATH_INFO: `/v3/users/e98121c4810f4c8f9a6fdd4c65aaba27` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:50.987027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98121c4810f4c8f9a6fdd4c65aaba27)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:50.990464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:51.034347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b5fd-c623-4819-b20a-1bff2335554a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:51.039305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6361-32d2-4247-94cc-172e5570ec1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:51.039968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6361-32d2-4247-94cc-172e5570ec1e service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:51.040265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6361-32d2-4247-94cc-172e5570ec1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:51.041163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6361-32d2-4247-94cc-172e5570ec1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:51.046804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98121c4810f4c8f9a6fdd4c65aaba27'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.058387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6361-32d2-4247-94cc-172e5570ec1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:51.059873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6361-32d2-4247-94cc-172e5570ec1e service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:51.061410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98121c4810f4c8f9a6fdd4c65aaba27'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.062478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98121c4810f4c8f9a6fdd4c65aaba27'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.063126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98121c4810f4c8f9a6fdd4c65aaba27'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.070847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98121c4810f4c8f9a6fdd4c65aaba27'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.079683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 950/1902] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:51.102047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 953/1903] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:50 2022] DELETE /identity/v3/users/e98121c4810f4c8f9a6fdd4c65aaba27 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:51.106995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:51.107505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:51.108905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:51.134537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:51.138199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:51.164218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:51.210816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 951/1904] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:51.224128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:51.225744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:51.329299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b618a9c-580f-4bc6-87c3-9a28ef3d7fc4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:51.333774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:51.335203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:51.335572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:51.335989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:51.349552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:51.351810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:51.367810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 954/1905] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:51.791455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:51.794561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:51.817349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f34b7c-668f-4284-8845-b681e79eaf9e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:51.824829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:51.826928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:51.827259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:51.827989 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] PATH_INFO: `/v3/projects/e477d3b4f7ce481cb5e3d61b91e62506` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:51.830765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e477d3b4f7ce481cb5e3d61b91e62506)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:51.834723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:51.931434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e477d3b4f7ce481cb5e3d61b91e62506', 'request_id': 'req-deef772a-fcdb-4251-abe5-65736ebbe330'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.940866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e477d3b4f7ce481cb5e3d61b91e62506', 'request_id': 'req-deef772a-fcdb-4251-abe5-65736ebbe330'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.948013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e477d3b4f7ce481cb5e3d61b91e62506', 'request_id': 'req-deef772a-fcdb-4251-abe5-65736ebbe330'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.960711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] The token cache is being invalidate because project e477d3b4f7ce481cb5e3d61b91e62506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:51.961011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.961683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:51.966345 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 952/1906] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:51 2022] DELETE /identity/v3/projects/e477d3b4f7ce481cb5e3d61b91e62506 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:51.968804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:51.979992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0aee1-d5cd-431b-8a32-ce7e16ac3f0f service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:52.009623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:52.009794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:52.011645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:52.056963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:52.057848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:52.058135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:52.058457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] PATH_INFO: `/v3/users/9b717dcebb4347b2b317c367adaa4ec9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:52.059678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b717dcebb4347b2b317c367adaa4ec9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:52.062599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:52.098463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef772a-fcdb-4251-abe5-65736ebbe330 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:52.103647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:52.104518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:52.104804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:52.105086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] PATH_INFO: `/v3/projects/794c6a8ee0ae4394b4546c5f8f60bc55` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:52.106280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794c6a8ee0ae4394b4546c5f8f60bc55)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:52.108518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:52.113015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b717dcebb4347b2b317c367adaa4ec9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.125613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b717dcebb4347b2b317c367adaa4ec9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.126324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b717dcebb4347b2b317c367adaa4ec9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.127034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b717dcebb4347b2b317c367adaa4ec9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.134160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b717dcebb4347b2b317c367adaa4ec9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.172324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 955/1907] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:51 2022] DELETE /identity/v3/users/9b717dcebb4347b2b317c367adaa4ec9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:52.181809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794c6a8ee0ae4394b4546c5f8f60bc55', 'request_id': 'req-9ede4514-5e35-4a6c-a27f-231be2834c04'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.187525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:52.194174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794c6a8ee0ae4394b4546c5f8f60bc55', 'request_id': 'req-9ede4514-5e35-4a6c-a27f-231be2834c04'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.208269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794c6a8ee0ae4394b4546c5f8f60bc55', 'request_id': 'req-9ede4514-5e35-4a6c-a27f-231be2834c04'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.221893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] The token cache is being invalidate because project 794c6a8ee0ae4394b4546c5f8f60bc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:52.222279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.223063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.224718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 953/1908] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:52 2022] DELETE /identity/v3/projects/794c6a8ee0ae4394b4546c5f8f60bc55 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:52.229151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:52.230637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:52.304920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9ad50-0e5c-47ca-9b43-99d598993fb6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:52.309618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:52.310897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:52.310897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:52.311148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] PATH_INFO: `/v3/users/e55002d509d84a28b90b0da7db1cc546` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:52.312387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55002d509d84a28b90b0da7db1cc546)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:52.314327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:52.369923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55002d509d84a28b90b0da7db1cc546'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.372545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:52.390242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55002d509d84a28b90b0da7db1cc546'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.391081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55002d509d84a28b90b0da7db1cc546'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.391712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55002d509d84a28b90b0da7db1cc546'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.399332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55002d509d84a28b90b0da7db1cc546'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.417563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 956/1909] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:52 2022] DELETE /identity/v3/users/e55002d509d84a28b90b0da7db1cc546 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:52.598211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:52.599880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:52.622620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:52.625565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:52.702427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede4514-5e35-4a6c-a27f-231be2834c04 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:52.725198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8874e-6156-4579-a595-a1ab6a33043d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:52.730589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:52.731806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:52.731806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:52.732200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] PATH_INFO: `/v3/users/b700a70b7efc40709486d89e6cdfd226` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:52.733843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b700a70b7efc40709486d89e6cdfd226)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:52.735932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:52.769386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:52.770882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:52.771633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:52.772468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] PATH_INFO: `/v3/projects/59d88706e09349a691286201d2b23b14` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:52.773945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d88706e09349a691286201d2b23b14)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:52.775928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:52.816178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b700a70b7efc40709486d89e6cdfd226'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.835722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b700a70b7efc40709486d89e6cdfd226'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.836510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b700a70b7efc40709486d89e6cdfd226'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.837154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b700a70b7efc40709486d89e6cdfd226'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.840045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d88706e09349a691286201d2b23b14', 'request_id': 'req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.846762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b700a70b7efc40709486d89e6cdfd226'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.849555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d88706e09349a691286201d2b23b14', 'request_id': 'req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.859443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d88706e09349a691286201d2b23b14', 'request_id': 'req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.891550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 957/1910] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:52 2022] DELETE /identity/v3/users/b700a70b7efc40709486d89e6cdfd226 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:52.892876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:52.894586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:52.896069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] The token cache is being invalidate because project 59d88706e09349a691286201d2b23b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:52.896741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.897690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0faf00ec-b9cc-4ad4-95f9-ae77487f5509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:52.900449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 954/1911] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:52 2022] DELETE /identity/v3/projects/59d88706e09349a691286201d2b23b14 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:52.902426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d0c5-3df8-48b9-9d1c-f1d5a8de5cb0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:52.903009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d0c5-3df8-48b9-9d1c-f1d5a8de5cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:52.906151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d0c5-3df8-48b9-9d1c-f1d5a8de5cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:52.929437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-bf99d0c5-3df8-48b9-9d1c-f1d5a8de5cb0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:52.931359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-bf99d0c5-3df8-48b9-9d1c-f1d5a8de5cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:52.947860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:53.018299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 955/1912] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:53.020025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.020323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.020598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.041249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:53.042568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.052639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 956/1913] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:53.059102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.059102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.094026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:53.124422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6a1f6-45bd-4cc5-8248-f9c93ab16cd9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.140137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.143743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.144436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.145473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] PATH_INFO: `/v3/projects/731eca550df7444e97f213dc755ed043` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.147717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] RBAC: Authorizing `identity:delete_project(project_id=731eca550df7444e97f213dc755ed043)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.151854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.186709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47dc8-7536-4108-8d93-47d85c140e5e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.197948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e422-a051-4e8f-bb5d-b109ce15f01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.201988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e422-a051-4e8f-bb5d-b109ce15f01e service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.202337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e422-a051-4e8f-bb5d-b109ce15f01e service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.205288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e422-a051-4e8f-bb5d-b109ce15f01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.236782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368e422-a051-4e8f-bb5d-b109ce15f01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.238254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368e422-a051-4e8f-bb5d-b109ce15f01e service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.244482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731eca550df7444e97f213dc755ed043', 'request_id': 'req-90e93fc5-aefa-4048-b873-ec4995c5478c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.253181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731eca550df7444e97f213dc755ed043', 'request_id': 'req-90e93fc5-aefa-4048-b873-ec4995c5478c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.258791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 957/1914] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:53.259809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.263904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.263904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.267669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731eca550df7444e97f213dc755ed043', 'request_id': 'req-90e93fc5-aefa-4048-b873-ec4995c5478c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.292644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] The token cache is being invalidate because project 731eca550df7444e97f213dc755ed043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:53.293324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:53.293761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.294832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.296269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-90e93fc5-aefa-4048-b873-ec4995c5478c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.300057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 958/1915] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:52 2022] DELETE /identity/v3/projects/731eca550df7444e97f213dc755ed043 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:53.316467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.316467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.316467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.338330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:53.339812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.394028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 958/1916] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:53.394976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.396838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.413290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30172-632b-4bf2-b39c-5061ba473f85 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.421598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.422623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.423086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.423687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] PATH_INFO: `/v3/users/326a4beeceb940318ab2111b42ca1aa8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.425440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] RBAC: Authorizing `identity:delete_user(user_id=326a4beeceb940318ab2111b42ca1aa8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.427776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.429394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 959/1917] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:53.430291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.441351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf417d-9f39-4b26-89cb-91380ba89f4f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.447844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.448587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.448925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.449456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.450274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:53.450626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.452609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3cadc-c40a-4f68-a27a-40f3bfa9bda3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.468367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 960/1918] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:53.470725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.471164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.471471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.497090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326a4beeceb940318ab2111b42ca1aa8'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.497902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326a4beeceb940318ab2111b42ca1aa8'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.504366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:53.508895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326a4beeceb940318ab2111b42ca1aa8'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.510317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326a4beeceb940318ab2111b42ca1aa8'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.511250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:53.515882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.521832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326a4beeceb940318ab2111b42ca1aa8'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:53.531917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 961/1919] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:53.543809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.546689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.548129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 959/1920] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:53 2022] DELETE /identity/v3/users/326a4beeceb940318ab2111b42ca1aa8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:53.549216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.563278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00746a-442c-4c90-aa1a-04773abeea38 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.641073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0a54-eda3-4fd0-b046-4bb50c66209c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.650520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.652859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.653735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.654117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.655995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:53.656395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.658842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b438c1-eb4c-4e30-af18-6627a6840d4d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.681685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 960/1921] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:53.683220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.683622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.684001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.685986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:53.697912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.698865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.702055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.702499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.703580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.706565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.710076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:53.711065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.722482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 961/1922] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:53.722482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.736274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3817d-054d-4d60-b643-8ef8bf2fd230 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.744155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.745162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.745636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.745729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.747248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.753470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.762544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 962/1923] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:53.763449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.770407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:53.807380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 962/1924] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:53.808558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.901497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23a6bf-3de1-43ca-8bd9-61d93e4e789f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.916527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6217-816a-4c33-aee1-946e197a6586 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.923469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.924162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.924447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.924726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.925436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.927442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.959735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 963/1925] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:53.959735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:53.964079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.964815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.965113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.965686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.972594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15253f-dba7-4d06-8e73-5501249f0734 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:53.977434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.978109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:53.978820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:53.978928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.979106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:53.979385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:53.980082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:53.982272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:53.992802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 963/1926] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:53.993535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.023027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 964/1927] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:53 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:54.028041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.031141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61869f5f-f71b-4ed0-b562-b48a5d92adc6 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.036888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.037831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.039002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.039458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.040415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.042180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33601-e72d-46ba-b7a0-e7b8be147c57 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.043720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.054310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.055151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.055439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.055721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.056982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.058193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.061782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 964/1928] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:54.061935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:54.063453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.078060 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaf465-760d-4ab5-b9c8-940ee323718e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.080115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 965/1929] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:54.081395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.093637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.094567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.095162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.099150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.101301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.104510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388456cd-52c4-4857-9adc-0c28fdc776ac admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.106930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.113972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.115327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.115751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.117849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.119217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.121520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.132114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 965/1930] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:54.136079 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.137169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 966/1931] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:54.141186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.150771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114d5ac-8163-4496-84f4-170f296c421e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.158561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810ce1-469b-4580-9a40-c66b8a6f4168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.159753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810ce1-469b-4580-9a40-c66b8a6f4168 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.161075 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810ce1-469b-4580-9a40-c66b8a6f4168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.161580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810ce1-469b-4580-9a40-c66b8a6f4168 admin admin] PATH_INFO: `/v3/projects/63b2c17379234dc58538d21b0eb1ebf8/users/f6536ace8edc480c87bed9d11989bfd4/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.170692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d35d7-d5f2-40ac-953f-3dc5a0d92baf admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.182509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a810ce1-469b-4580-9a40-c66b8a6f4168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b2c17379234dc58538d21b0eb1ebf8, user_id=f6536ace8edc480c87bed9d11989bfd4, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.183652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.184705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.185015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.185282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] PATH_INFO: `/v3/projects/2c9491258e4c47cab99e0afcc7e352c7/users/f4a7123267034160a762db61e7acf843/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.185585 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a810ce1-469b-4580-9a40-c66b8a6f4168 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.213893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 966/1932] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:54 2022] PUT /identity/v3/projects/63b2c17379234dc58538d21b0eb1ebf8/users/f6536ace8edc480c87bed9d11989bfd4/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:54.219681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8417c1-a6f1-4fe9-81f6-e2180184b881 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.219681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8417c1-a6f1-4fe9-81f6-e2180184b881 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.220318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8417c1-a6f1-4fe9-81f6-e2180184b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.225255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9491258e4c47cab99e0afcc7e352c7, user_id=f4a7123267034160a762db61e7acf843, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.228311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.260782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 967/1933] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:54 2022] PUT /identity/v3/projects/2c9491258e4c47cab99e0afcc7e352c7/users/f4a7123267034160a762db61e7acf843/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:54.261118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ad8417c1-a6f1-4fe9-81f6-e2180184b881 None None] MFA Rules not processed for user `f6536ace8edc480c87bed9d11989bfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:54.261118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ad8417c1-a6f1-4fe9-81f6-e2180184b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.266452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.272378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.411021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:54.433383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d6e0-ae82-4097-9037-4369c0863039 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.440882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.442568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.442944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.443341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] PATH_INFO: `/v3/projects/a3ba84cfbee54d8b9e7274c4f9d69318` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.445685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ba84cfbee54d8b9e7274c4f9d69318)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.448028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.453596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 967/1934] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:54.455094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.455649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.455649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.499130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] MFA Rules not processed for user `f4a7123267034160a762db61e7acf843`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:54.500190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.524561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ba84cfbee54d8b9e7274c4f9d69318', 'request_id': 'req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.541104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ba84cfbee54d8b9e7274c4f9d69318', 'request_id': 'req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.554437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ba84cfbee54d8b9e7274c4f9d69318', 'request_id': 'req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.572614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] The token cache is being invalidate because project a3ba84cfbee54d8b9e7274c4f9d69318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:54.573038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.573848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.578998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 968/1935] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:54 2022] DELETE /identity/v3/projects/a3ba84cfbee54d8b9e7274c4f9d69318 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:54.578998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.581260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.634686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 968/1936] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:54.635740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.638567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.660852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f828b-e09f-43c8-9d3a-51ea1cdfe82c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.678050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.680295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.681351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.682635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.688310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.696424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:54.741466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba86c4-ec75-4dc9-adfa-0f635e402b84 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.749570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:54.749909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:54.750151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:54.750465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] PATH_INFO: `/v3/projects/d25b328168f04b36b0f3044beceeaaa3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:54.751967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25b328168f04b36b0f3044beceeaaa3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.754345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.783791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:54.786041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:54.800905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 969/1937] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:54.804895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.808236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.841584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25b328168f04b36b0f3044beceeaaa3', 'request_id': 'req-97e85846-f7dd-400a-b449-a312d7f613c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.850134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1371-afcd-4649-9fc4-0531c886f2e5 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:54.851257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25b328168f04b36b0f3044beceeaaa3', 'request_id': 'req-97e85846-f7dd-400a-b449-a312d7f613c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.862034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25b328168f04b36b0f3044beceeaaa3', 'request_id': 'req-97e85846-f7dd-400a-b449-a312d7f613c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.886206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] The token cache is being invalidate because project d25b328168f04b36b0f3044beceeaaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:54.886706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.888311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:54.891086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 969/1938] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:54 2022] DELETE /identity/v3/projects/d25b328168f04b36b0f3044beceeaaa3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:54.892260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:54.894110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:54.911234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:55.015946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e85846-f7dd-400a-b449-a312d7f613c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.020375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.022467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.023642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.023945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] PATH_INFO: `/v3/users/4b8fa55051054899b3f65b587afc93ce` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.028000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8fa55051054899b3f65b587afc93ce)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.029262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.034144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.034481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.035024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.035458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.037365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.040101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.127756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 970/1939] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:54 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:55.127756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:55.132359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:55.186405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8fa55051054899b3f65b587afc93ce'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.187343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8fa55051054899b3f65b587afc93ce'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.204148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8fa55051054899b3f65b587afc93ce'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.205278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8fa55051054899b3f65b587afc93ce'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.218201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8fa55051054899b3f65b587afc93ce'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.242009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 970/1940] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:54 2022] DELETE /identity/v3/users/4b8fa55051054899b3f65b587afc93ce => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:55.243570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:55.245048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:55.283916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:55.376061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e62e-4e19-432e-a2c7-912e0e3f5a52 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.387837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.392146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.392448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.394274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.401655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.406562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.412342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab397d5-5ada-4795-8f55-5189599a48d0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.447609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 971/1941] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:55 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:55.448518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.449425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.449765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.451764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:55.456689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] PATH_INFO: `/v3/users/a47ae750a4764655861eb40bddafdc59` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.466425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47ae750a4764655861eb40bddafdc59)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.470609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456c3c-e726-4dd3-b3f2-4d8d4b9fb351 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.475320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.479234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.480756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.481524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.483024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.485525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.488454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.522963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 972/1942] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:55.526870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:55.554413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bce73-b3f8-401b-97ec-7b7135a907f9 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.562689 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.564458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.564856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.565290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] PATH_INFO: `/v3/projects/b9a2c19e40e7453d8ec3476d1521c291/users/67fb23416b984acab64ec096a4b25f40/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.599934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a2c19e40e7453d8ec3476d1521c291, user_id=67fb23416b984acab64ec096a4b25f40, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.603768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.645404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47ae750a4764655861eb40bddafdc59'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.645713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 973/1943] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:55 2022] PUT /identity/v3/projects/b9a2c19e40e7453d8ec3476d1521c291/users/67fb23416b984acab64ec096a4b25f40/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:45:55.646002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:55.663883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47ae750a4764655861eb40bddafdc59'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.664707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47ae750a4764655861eb40bddafdc59'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.674015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47ae750a4764655861eb40bddafdc59'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.683649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47ae750a4764655861eb40bddafdc59'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:55.715815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 971/1944] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:55 2022] DELETE /identity/v3/users/a47ae750a4764655861eb40bddafdc59 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:55.799333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcd1a6-3d5d-47e9-a1e3-bf74721467f0 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.875687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9e88-0e50-4387-b195-ae81781b3ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.876374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9e88-0e50-4387-b195-ae81781b3ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.876644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9e88-0e50-4387-b195-ae81781b3ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.876929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9e88-0e50-4387-b195-ae81781b3ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.877957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9e88-0e50-4387-b195-ae81781b3ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.879642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9e88-0e50-4387-b195-ae81781b3ca9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.894539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 974/1945] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:55.899479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:55.901952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:55.923875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f979e83-ff33-413c-9bb0-a9ce432c99db admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:55.931104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:55.932023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.932962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.933245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] PATH_INFO: `/v3/projects/b9a2c19e40e7453d8ec3476d1521c291/users/67fb23416b984acab64ec096a4b25f40/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.935508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a2c19e40e7453d8ec3476d1521c291, user_id=67fb23416b984acab64ec096a4b25f40, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:55.938616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:55.942090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:55.960964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 972/1946] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:55 2022] PUT /identity/v3/projects/b9a2c19e40e7453d8ec3476d1521c291/users/67fb23416b984acab64ec096a4b25f40/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:55.963468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:55.963759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:55.964081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:55.994786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] MFA Rules not processed for user `67fb23416b984acab64ec096a4b25f40`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:55.996026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.007744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:56.090387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 975/1947] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:56.102033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:56.103746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.190560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4332c9-8c40-4fd2-99bc-2df5c1d67498 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:56.194346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:56.195028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:56.195344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:56.195744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:56.197797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.274398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:56.275944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:56.302153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 973/1948] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:56.320876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:56.323099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.386080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:56.387613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.452338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c9c1-7259-41fb-9385-f4a898539f46 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:56.457481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:56.458502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:56.458794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:56.459073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] PATH_INFO: `/v3/projects/0cbe3c6db25043a7826f3743a7935f45` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:56.460434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbe3c6db25043a7826f3743a7935f45)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:56.462389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:56.515676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd0691-c705-42c8-a714-c1f115194df6 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:56.518991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbe3c6db25043a7826f3743a7935f45', 'request_id': 'req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.528196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbe3c6db25043a7826f3743a7935f45', 'request_id': 'req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.539197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbe3c6db25043a7826f3743a7935f45', 'request_id': 'req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.556311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] The token cache is being invalidate because project 0cbe3c6db25043a7826f3743a7935f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:56.557030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.557712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.562868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 976/1949] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:56 2022] DELETE /identity/v3/projects/0cbe3c6db25043a7826f3743a7935f45 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:56.566471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:56.569857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.603727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:56.613523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:56.614504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:56.614936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:56.615280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] PATH_INFO: `/v3/projects/9231799e634a455486fdebbb278da470` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:56.616634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9231799e634a455486fdebbb278da470)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:56.618972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:56.641853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:56.710066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9231799e634a455486fdebbb278da470', 'request_id': 'req-a20f3217-57d2-4fc8-ae22-768d333c744f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.712553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e9a6-6f5f-4c4e-8489-cd41d0ddf582 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:56.719854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9231799e634a455486fdebbb278da470', 'request_id': 'req-a20f3217-57d2-4fc8-ae22-768d333c744f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.740765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9231799e634a455486fdebbb278da470', 'request_id': 'req-a20f3217-57d2-4fc8-ae22-768d333c744f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.765465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] The token cache is being invalidate because project 9231799e634a455486fdebbb278da470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:56.766004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.766971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a20f3217-57d2-4fc8-ae22-768d333c744f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:56.777505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 974/1950] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:56 2022] DELETE /identity/v3/projects/9231799e634a455486fdebbb278da470 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:56.778149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864677fb-1937-4d9b-ac1e-0be9225948f6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:56.778457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864677fb-1937-4d9b-ac1e-0be9225948f6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:56.779219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864677fb-1937-4d9b-ac1e-0be9225948f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:56.825115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-864677fb-1937-4d9b-ac1e-0be9225948f6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:56.827199 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-864677fb-1937-4d9b-ac1e-0be9225948f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:56.858875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:56.859872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:56.861089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:56.861089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] PATH_INFO: `/v3/users/784e5e80424941c193b3f174f6af9e7d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:56.864547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784e5e80424941c193b3f174f6af9e7d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:56.867688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:56.968180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 975/1951] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:56.976633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:56.977098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:56.977385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.000108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784e5e80424941c193b3f174f6af9e7d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.001041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784e5e80424941c193b3f174f6af9e7d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.010256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784e5e80424941c193b3f174f6af9e7d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.011263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784e5e80424941c193b3f174f6af9e7d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.014610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:57.016481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.027738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784e5e80424941c193b3f174f6af9e7d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.034042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 976/1952] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:57.039460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.058234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 977/1953] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:45:56 2022] DELETE /identity/v3/users/784e5e80424941c193b3f174f6af9e7d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:57.062480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056524-9ae7-4e4d-b39f-e6c6cc43f30e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.142989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.144352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.144655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.144946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.145695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:57.146014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.148035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.169561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 977/1954] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:57.174637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.194055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147924-bfb7-4629-ab42-cf201d772b17 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.202223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.203401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.203791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.204173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.205163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.208125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.277001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 978/1955] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:57 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:57.282853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.300006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ef66d-077f-4afb-9526-2783999a252e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.332731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:57.438538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.439384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.439749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.443309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.443309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.457523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.489634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 978/1956] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:57 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:57.492939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.507556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec876b1b-7e53-48e2-9881-f3c4500a32d1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.515649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.517068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.517512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.517956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.518911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.520933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.540451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 979/1957] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:57.543193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.562088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b42b29-91cd-489d-a5fa-e91b958998dc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.567705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.568517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.568809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.569091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.569828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.571483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.584520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 979/1958] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:45:57.588990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.599884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1eff0-5780-425c-9291-0cfbbb9dd100 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.607259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4da701-c93f-4265-b690-27bf39a3fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.607259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da701-c93f-4265-b690-27bf39a3fb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.607259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da701-c93f-4265-b690-27bf39a3fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.607259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da701-c93f-4265-b690-27bf39a3fb8b admin admin] PATH_INFO: `/v3/projects/16b39ef7e23f47ac94133f827e3b4a11/users/19d17df3bf94409296ef5f133494ab39/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.609436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.611323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.628018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6f4a-9ab2-4611-b601-666f0df32b09 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.631768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4da701-c93f-4265-b690-27bf39a3fb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b39ef7e23f47ac94133f827e3b4a11, user_id=19d17df3bf94409296ef5f133494ab39, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.634402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.635230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4da701-c93f-4265-b690-27bf39a3fb8b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.635399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.635758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.636106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] PATH_INFO: `/v3/projects/c0395bbb0c124126b1e391e726a1afd1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.637406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0395bbb0c124126b1e391e726a1afd1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.640134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.653498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 980/1959] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:57 2022] PUT /identity/v3/projects/16b39ef7e23f47ac94133f827e3b4a11/users/19d17df3bf94409296ef5f133494ab39/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:57.655140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e16b-986d-4c42-a477-47185be33193 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.655535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e16b-986d-4c42-a477-47185be33193 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.655918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e16b-986d-4c42-a477-47185be33193 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.657851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 981/1960] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:45:57.659788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11e4d-a484-4211-be8a-39f958b74a47 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.660444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11e4d-a484-4211-be8a-39f958b74a47 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.660968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11e4d-a484-4211-be8a-39f958b74a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.693458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:57.700821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2da11e4d-a484-4211-be8a-39f958b74a47 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:57.703978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2da11e4d-a484-4211-be8a-39f958b74a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.712196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0395bbb0c124126b1e391e726a1afd1', 'request_id': 'req-0881ec1c-9143-45c9-a24c-64406ac9f2f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.722593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0395bbb0c124126b1e391e726a1afd1', 'request_id': 'req-0881ec1c-9143-45c9-a24c-64406ac9f2f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.729880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0395bbb0c124126b1e391e726a1afd1', 'request_id': 'req-0881ec1c-9143-45c9-a24c-64406ac9f2f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.746302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] The token cache is being invalidate because project c0395bbb0c124126b1e391e726a1afd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:45:57.747284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.747963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0881ec1c-9143-45c9-a24c-64406ac9f2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:45:57.750606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 980/1961] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:45:57 2022] DELETE /identity/v3/projects/c0395bbb0c124126b1e391e726a1afd1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:57.751771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86462-c673-412b-84a9-5169cffab65d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.752072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86462-c673-412b-84a9-5169cffab65d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.752357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86462-c673-412b-84a9-5169cffab65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.772828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6ce86462-c673-412b-84a9-5169cffab65d None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:57.774068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6ce86462-c673-412b-84a9-5169cffab65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.782970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 982/1962] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:57.797412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.797841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.798272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.820517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:57.821823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.831274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 983/1963] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:57.832098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.833359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.865239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 981/1964] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:57.867000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.867296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.867580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.905196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:57.908037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.919958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 982/1965] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:57.922248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.923981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:57.933610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f0d7-7213-46ec-a7cc-4e29bc1bf160 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.938815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.939487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.939955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.940245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.950485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2809-4ce3-43ab-bda5-89045c80be0c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.953165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:57.960019 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.960653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:57.960960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.961062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:57.961316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:57.962560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.974664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:57.976192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:57.978491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 984/1966] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:57.979420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:57.991729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cada58-9b8b-48dc-ab57-6aea3fde9729 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:57.998020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:57.999856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.000379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.002844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.004445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:45:58.004977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.006884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:58.009325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 983/1967] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:58.022032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 985/1968] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:45:58.027122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:58.041504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63042513-a1e9-4ca8-8861-af5c5fe987c6 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:58.047750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:58.048881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.049246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.050722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.051559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.053920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:58.128281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 984/1969] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:58 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:58.132341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:58.152782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92298055-cfc7-43fa-8858-bfbd3c564b7d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:58.276093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:58.277464 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.277887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.278331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.279207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.283581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:58.343331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 986/1970] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:58 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:58.348081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:58.365720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37c6b6-b6ca-484d-b619-9eb3865e2f8c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:58.386923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:58.387845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.388137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.388506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.390168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.392021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:58.418466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 985/1971] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:58.422718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:58.434604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9216903-3a27-4f45-a2bb-bf505939c0e0 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:58.463965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c660-08e9-4509-9f20-81abace210f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:58.465090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c660-08e9-4509-9f20-81abace210f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.466830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c660-08e9-4509-9f20-81abace210f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.469699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c660-08e9-4509-9f20-81abace210f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.471644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c660-08e9-4509-9f20-81abace210f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.485642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c660-08e9-4509-9f20-81abace210f0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:58.502261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 987/1972] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:58.507205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:58.528118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4d816-7051-4f7d-82e9-cda5abf127c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:58.531316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:58.532374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.532850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.533280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] PATH_INFO: `/v3/projects/9a4327c34b38406a816684925ad8afab/users/3c25f883ac2f4e93ac19d9a62eb657bc/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.556258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4327c34b38406a816684925ad8afab, user_id=3c25f883ac2f4e93ac19d9a62eb657bc, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.560180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:58.583601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 986/1973] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:58 2022] PUT /identity/v3/projects/9a4327c34b38406a816684925ad8afab/users/3c25f883ac2f4e93ac19d9a62eb657bc/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:58.596555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.597252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.597536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.633580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:58.660312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] MFA Rules not processed for user `3c25f883ac2f4e93ac19d9a62eb657bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:58.661958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:58.800184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 988/1974] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:58.801655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:58.927174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f115-5b57-49fa-8873-d7392b48ff72 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:58.943671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:58.944899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:58.945298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:58.945726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:58.946580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:58.949978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.006191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 987/1975] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:58 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:59.007465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.028653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbefc6-4f72-4485-9386-d7f7243e7d78 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.122498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.123247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.123656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.123954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.124685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.127944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.151668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 989/1976] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:59 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:59.156871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.169043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778af5-bea8-42e7-9fe2-4428f0b8c07b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.174326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.175057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.175347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.175631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.176377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.178007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.191182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 988/1977] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:59.195034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.207757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4905e3-f423-42fd-a581-53de853c9b12 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.213034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de246f2d-8ee8-484f-ad49-79ff8a3c82c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.213946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246f2d-8ee8-484f-ad49-79ff8a3c82c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.214235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246f2d-8ee8-484f-ad49-79ff8a3c82c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.214555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246f2d-8ee8-484f-ad49-79ff8a3c82c9 admin admin] PATH_INFO: `/v3/projects/e9eb0ad802904a31a3015883260bd99d/users/a4834987929f4aaba59f8e608641696b/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.230854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de246f2d-8ee8-484f-ad49-79ff8a3c82c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9eb0ad802904a31a3015883260bd99d, user_id=a4834987929f4aaba59f8e608641696b, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.234766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de246f2d-8ee8-484f-ad49-79ff8a3c82c9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.252864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 990/1978] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:59 2022] PUT /identity/v3/projects/e9eb0ad802904a31a3015883260bd99d/users/a4834987929f4aaba59f8e608641696b/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:59.257278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.273132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872352c0-8626-46d8-ba18-8075da13533b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.325125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c147e-3471-4501-8269-518bee38f61f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.325676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c147e-3471-4501-8269-518bee38f61f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.325676 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c147e-3471-4501-8269-518bee38f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.366843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.368615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.369089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.369553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.370168 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-038c147e-3471-4501-8269-518bee38f61f None None] MFA Rules not processed for user `19d17df3bf94409296ef5f133494ab39`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:59.370751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.371633 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-038c147e-3471-4501-8269-518bee38f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:59.372896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.388836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 989/1979] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:59.407856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.419638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:59.430608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8e43-8245-435d-9005-3866dd674578 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.443773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d144c-5fe4-4204-ab96-877d830d8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.445239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d144c-5fe4-4204-ab96-877d830d8292 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.445239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d144c-5fe4-4204-ab96-877d830d8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.445239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d144c-5fe4-4204-ab96-877d830d8292 admin admin] PATH_INFO: `/v3/projects/e9eb0ad802904a31a3015883260bd99d/users/a4834987929f4aaba59f8e608641696b/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.456121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d144c-5fe4-4204-ab96-877d830d8292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9eb0ad802904a31a3015883260bd99d, user_id=a4834987929f4aaba59f8e608641696b, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.458832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d144c-5fe4-4204-ab96-877d830d8292 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.478516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 990/1980] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:59 2022] PUT /identity/v3/projects/e9eb0ad802904a31a3015883260bd99d/users/a4834987929f4aaba59f8e608641696b/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:59.482723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.483187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.483658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.490018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:59.510592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 991/1981] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:59.517004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c147e-3471-4501-8269-518bee38f61f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.519537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-038c147e-3471-4501-8269-518bee38f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:59.527728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] MFA Rules not processed for user `a4834987929f4aaba59f8e608641696b`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:59.531012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:59.546722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c147e-3471-4501-8269-518bee38f61f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.624254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.625162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.625662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.626560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.627528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.629692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.661427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 991/1982] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:45:59.664143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 992/1983] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:45:59 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:45:59.678061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.678612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.678612 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:59.689735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced845f5-34dc-44f0-8e9b-cca50703f6d8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.751193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c832-86c2-4f71-9fd6-7ef834a7d9c0 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.755089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.756399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.756399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.756628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.768171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.768933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.769317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.769666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.770491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.772648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.816853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 992/1984] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:45:59 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:45:59.822501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.831465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.833444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.838964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2926c-5309-4f75-8d84-aa4cf6612932 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.845265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.846083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.846476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.846972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.847382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 993/1985] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:59.851127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.853442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.866845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 993/1986] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:45:59.871078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.887571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08867b-21f7-4369-8729-1611f75dc8e7 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:59.897183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:59.897183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:59.897183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:59.897183 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] PATH_INFO: `/v3/projects/2c03f00770f34ddcb558bd1eb990cbf2/users/c0f3f116186f4129b8572887b3a25501/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:59.919415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03f00770f34ddcb558bd1eb990cbf2, user_id=c0f3f116186f4129b8572887b3a25501, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:59.923662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:59.944977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 994/1987] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:45:59 2022] PUT /identity/v3/projects/2c03f00770f34ddcb558bd1eb990cbf2/users/c0f3f116186f4129b8572887b3a25501/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:45:59.950227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:59.972192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d987cd-2c76-4316-8d69-725b23b6cb2e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:00.053300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:00.071528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:00.072441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:00.072885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:00.073596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:00.074593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:00.076624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:00.111822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 994/1988] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:00.115961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:00.127998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:00.140115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e35dea-55b4-4815-bb07-78fa0585a85c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:00.157238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d3ae8-6ca6-4e2c-8f34-35d88d4b594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:00.158251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d3ae8-6ca6-4e2c-8f34-35d88d4b594d admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:00.158658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d3ae8-6ca6-4e2c-8f34-35d88d4b594d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:00.158948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d3ae8-6ca6-4e2c-8f34-35d88d4b594d admin admin] PATH_INFO: `/v3/projects/2c03f00770f34ddcb558bd1eb990cbf2/users/c0f3f116186f4129b8572887b3a25501/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:00.167709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d3ae8-6ca6-4e2c-8f34-35d88d4b594d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03f00770f34ddcb558bd1eb990cbf2, user_id=c0f3f116186f4129b8572887b3a25501, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:00.171785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d3ae8-6ca6-4e2c-8f34-35d88d4b594d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:00.188484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 995/1989] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:00 2022] PUT /identity/v3/projects/2c03f00770f34ddcb558bd1eb990cbf2/users/c0f3f116186f4129b8572887b3a25501/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:00.596710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:00.609778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76132b-c136-4ae8-bd0a-f358bac6a8b1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:00.713623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:00.714703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:00.715055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:00.715441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] PATH_INFO: `/v3/users/3c25f883ac2f4e93ac19d9a62eb657bc` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:00.716930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c25f883ac2f4e93ac19d9a62eb657bc)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:00.719003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:00.781373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c25f883ac2f4e93ac19d9a62eb657bc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:00.799996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c25f883ac2f4e93ac19d9a62eb657bc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:00.800918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c25f883ac2f4e93ac19d9a62eb657bc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:00.801621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c25f883ac2f4e93ac19d9a62eb657bc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:00.810468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c25f883ac2f4e93ac19d9a62eb657bc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:00.835768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 995/1990] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:00 2022] DELETE /identity/v3/users/3c25f883ac2f4e93ac19d9a62eb657bc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:00.842933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:00.843717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:00.844000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:00.866812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:00.869761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:00.957918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 996/1991] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:00.973387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:00.975242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:01.054408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15054-a06d-487c-ab77-407820ee5bcb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:01.060227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54f207-0434-48ff-aefc-f302fcc2654f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:01.061575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f207-0434-48ff-aefc-f302fcc2654f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:01.061998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f207-0434-48ff-aefc-f302fcc2654f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:01.062417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f207-0434-48ff-aefc-f302fcc2654f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:01.073604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54f207-0434-48ff-aefc-f302fcc2654f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:01.075322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54f207-0434-48ff-aefc-f302fcc2654f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:01.096206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 996/1992] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:01.341436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:01.343255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:01.476844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a92e-b8c9-4add-a7eb-dc3c9e423bae None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:01.495124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:01.495933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:01.496326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:01.496674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:01.502999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:01.605357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:01.606895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:01.620247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 997/1993] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:01.776145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:01.776701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:01.776701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:01.805578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:01.822618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] MFA Rules not processed for user `c0f3f116186f4129b8572887b3a25501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:01.825087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:01.958702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 997/1994] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:02.004874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:02.006714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:02.024995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4b20-58ca-474a-b341-4e63046e33b5 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:02.032221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:02.033293 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:02.034094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:02.034697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] PATH_INFO: `/v3/projects/9a4327c34b38406a816684925ad8afab` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:02.036977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4327c34b38406a816684925ad8afab)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:02.039836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:02.127814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:02.155752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4327c34b38406a816684925ad8afab', 'request_id': 'req-caa6c021-72d0-4da1-b336-2e7d9e63b318'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.161077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:02.163266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:02.186449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981f71-cd85-4e9d-aa71-4af81f555984 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:02.187071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4327c34b38406a816684925ad8afab', 'request_id': 'req-caa6c021-72d0-4da1-b336-2e7d9e63b318'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.194599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4327c34b38406a816684925ad8afab', 'request_id': 'req-caa6c021-72d0-4da1-b336-2e7d9e63b318'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.215733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] The token cache is being invalidate because project 9a4327c34b38406a816684925ad8afab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:02.216084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.217537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.221158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 998/1995] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:02 2022] DELETE /identity/v3/projects/9a4327c34b38406a816684925ad8afab => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:02.226670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:02.230990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:02.294512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:02.296366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:02.296709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:02.297442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:02.303740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:02.369012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c021-72d0-4da1-b336-2e7d9e63b318 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:02.376029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:02.377114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:02.377412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:02.377693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] PATH_INFO: `/v3/users/a4834987929f4aaba59f8e608641696b` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:02.379333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4834987929f4aaba59f8e608641696b)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:02.381313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:02.393607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:02.395319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:02.406195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 998/1996] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:02.435003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4834987929f4aaba59f8e608641696b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.436299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4834987929f4aaba59f8e608641696b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.445565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4834987929f4aaba59f8e608641696b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.446468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4834987929f4aaba59f8e608641696b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.455100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-059e11ec-403c-470b-b6b7-3e4b296db4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4834987929f4aaba59f8e608641696b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:02.475950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 999/1997] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:02 2022] DELETE /identity/v3/users/a4834987929f4aaba59f8e608641696b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:02.819990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:02.844360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27ccc7-8379-4ffd-9e0c-36bf7365cb9e service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:02.906116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:02.926472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:02.927767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:02.928160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:02.928506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] PATH_INFO: `/v3/projects/e9eb0ad802904a31a3015883260bd99d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:02.937629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9eb0ad802904a31a3015883260bd99d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:02.937629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.009201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9eb0ad802904a31a3015883260bd99d', 'request_id': 'req-5be64f00-805f-436e-95d9-66e805682e1e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:03.017901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9eb0ad802904a31a3015883260bd99d', 'request_id': 'req-5be64f00-805f-436e-95d9-66e805682e1e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:03.025778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9eb0ad802904a31a3015883260bd99d', 'request_id': 'req-5be64f00-805f-436e-95d9-66e805682e1e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:03.043809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] The token cache is being invalidate because project e9eb0ad802904a31a3015883260bd99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:03.044117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:03.045456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5be64f00-805f-436e-95d9-66e805682e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:03.047663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 999/1998] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:02 2022] DELETE /identity/v3/projects/e9eb0ad802904a31a3015883260bd99d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:03.052406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.052903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.053005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.074071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:03.075291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:03.138388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:03.174928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1000/1999] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:03.182893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.183194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.183483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.202501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:03.203739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:03.211697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1000/2000] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:03.215917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.226400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafd093-5e6a-41a8-aaa2-5db7b1c256b4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.231064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.231723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.232012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.232297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.233604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:03.233951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.235595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.247011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1001/2001] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:03.252395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.262244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d6f7-49eb-4c1c-96c9-74756bbca966 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.268665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.269381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.269651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.269931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.270700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.272598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.309953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1001/2002] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:03 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:03.315468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.326880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c9ae-181c-4118-a9c0-84ed360afaa4 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.401224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.402819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.403117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.403398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.405055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.407073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.442095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1002/2003] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:03 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:03.445900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.460712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568c9c2-3089-40d9-9d26-5d0af62cbbcc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.468032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.469073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.469565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.470156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.471254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.474344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.493882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1002/2004] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:03.497631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.522044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d3b78-0534-4ebb-8354-307d94ee126f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.526896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522bd7d-f340-4521-b503-1a76204638e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.527572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522bd7d-f340-4521-b503-1a76204638e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.527859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522bd7d-f340-4521-b503-1a76204638e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.528141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522bd7d-f340-4521-b503-1a76204638e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.528875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522bd7d-f340-4521-b503-1a76204638e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.531002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522bd7d-f340-4521-b503-1a76204638e9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.542275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1003/2005] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:03.546840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.556938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8217-556c-4b29-a664-52a4263e1d6d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.562816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.563722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.564011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.564293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] PATH_INFO: `/v3/projects/ec89f8007cac476a954fdfd410a10af5/users/50fd095e3fbb4185832fc31b0742b79b/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.580781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec89f8007cac476a954fdfd410a10af5, user_id=50fd095e3fbb4185832fc31b0742b79b, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.583548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.597203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1003/2006] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:03 2022] PUT /identity/v3/projects/ec89f8007cac476a954fdfd410a10af5/users/50fd095e3fbb4185832fc31b0742b79b/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:03.609341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.609640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.609932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.640558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] MFA Rules not processed for user `50fd095e3fbb4185832fc31b0742b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:03.641730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:03.706041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1004/2007] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:03.718089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.719819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:03.776063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313e6a2-b3db-49dd-b814-086fcd822a0e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.779977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.780634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.780923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.781206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.790140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.791639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.800783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1004/2008] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:03.829081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:03.830688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:03.843647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057bca4-9438-4d7b-8b68-ba30da3993fe None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:03.847724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:03.848503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:03.848886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:03.849177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:03.851048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:03.893587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:03.919643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:03.921258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182502ee-68d5-408f-9ed9-d368ba05ccde service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:03.930999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1005/2009] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:12.428292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:12.433665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:12.468515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:12.543926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb5ea-e6c1-4b93-98d5-f1312244fbd8 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:12.550408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:12.551566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:12.552174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:12.552599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] PATH_INFO: `/v3/users/f4a7123267034160a762db61e7acf843` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:12.555242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a7123267034160a762db61e7acf843)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:12.559013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:12.647885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a7123267034160a762db61e7acf843'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:12.670477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a7123267034160a762db61e7acf843'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:12.672207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a7123267034160a762db61e7acf843'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:12.673304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a7123267034160a762db61e7acf843'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:12.693311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a7123267034160a762db61e7acf843'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:12.714903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1005/2010] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:12 2022] DELETE /identity/v3/users/f4a7123267034160a762db61e7acf843 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:12.719923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:12.720459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:12.720583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:12.742399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:12.743938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:12.878617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1006/2011] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:12.890061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:12.891627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:13.006070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485f187-a564-4087-9d40-b196b12c6ae0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:13.015317 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:13.017982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:13.018475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:13.018925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:13.058294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:13.060478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:13.076666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1006/2012] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:13.883948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:13.885692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:13.901317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89592-5cf6-4ff4-bfc7-3e2261b73b17 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:13.907705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:13.908699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:13.909044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:13.909327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] PATH_INFO: `/v3/projects/2c9491258e4c47cab99e0afcc7e352c7` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:13.911219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9491258e4c47cab99e0afcc7e352c7)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:13.913344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:13.976994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9491258e4c47cab99e0afcc7e352c7', 'request_id': 'req-f4883923-b2bc-4810-a6e7-4daccbc69c84'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:13.985887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9491258e4c47cab99e0afcc7e352c7', 'request_id': 'req-f4883923-b2bc-4810-a6e7-4daccbc69c84'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:13.994782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9491258e4c47cab99e0afcc7e352c7', 'request_id': 'req-f4883923-b2bc-4810-a6e7-4daccbc69c84'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.007325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] The token cache is being invalidate because project 2c9491258e4c47cab99e0afcc7e352c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:14.007846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.008665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.016501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1007/2013] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:13 2022] DELETE /identity/v3/projects/2c9491258e4c47cab99e0afcc7e352c7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:14.017033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:14.028169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e840e-d49a-49e4-9b8d-8df66bcf9575 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:14.089992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:14.124978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:14.126038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:14.126481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:14.127327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] PATH_INFO: `/v3/users/67fb23416b984acab64ec096a4b25f40` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:14.130081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fb23416b984acab64ec096a4b25f40)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:14.132519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:14.206812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fb23416b984acab64ec096a4b25f40'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.228126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fb23416b984acab64ec096a4b25f40'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.229883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fb23416b984acab64ec096a4b25f40'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.230960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fb23416b984acab64ec096a4b25f40'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.245594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fb23416b984acab64ec096a4b25f40'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.271618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1007/2014] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:14 2022] DELETE /identity/v3/users/67fb23416b984acab64ec096a4b25f40 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:14.683637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:14.685290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:14.708374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4883923-b2bc-4810-a6e7-4daccbc69c84 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:14.776443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:14.786637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:14.789980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:14.794472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:14.795051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] PATH_INFO: `/v3/projects/b9a2c19e40e7453d8ec3476d1521c291` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:14.797083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:14.797710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a2c19e40e7453d8ec3476d1521c291)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:14.798874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:14.801202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:14.837110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc4d0a-e25f-47da-9f69-b8cfee550b3f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:14.845284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:14.846405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:14.846813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:14.847201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] PATH_INFO: `/v3/users/50fd095e3fbb4185832fc31b0742b79b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:14.848758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fd095e3fbb4185832fc31b0742b79b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:14.851302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:14.930774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a2c19e40e7453d8ec3476d1521c291', 'request_id': 'req-3568fecf-d717-4e55-9e13-cf1850991e8d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.947691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a2c19e40e7453d8ec3476d1521c291', 'request_id': 'req-3568fecf-d717-4e55-9e13-cf1850991e8d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.962514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a2c19e40e7453d8ec3476d1521c291', 'request_id': 'req-3568fecf-d717-4e55-9e13-cf1850991e8d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.976265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fd095e3fbb4185832fc31b0742b79b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.982408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] The token cache is being invalidate because project b9a2c19e40e7453d8ec3476d1521c291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:14.984128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.985127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3568fecf-d717-4e55-9e13-cf1850991e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.992440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1008/2015] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:14 2022] DELETE /identity/v3/projects/b9a2c19e40e7453d8ec3476d1521c291 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:14.994308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580fa00-9a53-480e-8b7d-54cb2b7895a7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:14.995524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fd095e3fbb4185832fc31b0742b79b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.996416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fd095e3fbb4185832fc31b0742b79b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.997406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fd095e3fbb4185832fc31b0742b79b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:14.999872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580fa00-9a53-480e-8b7d-54cb2b7895a7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.003946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580fa00-9a53-480e-8b7d-54cb2b7895a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.008158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd516936-16f0-40b4-82ad-bdde13bb19c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fd095e3fbb4185832fc31b0742b79b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:15.032929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1008/2016] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:14 2022] DELETE /identity/v3/users/50fd095e3fbb4185832fc31b0742b79b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:15.035530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3580fa00-9a53-480e-8b7d-54cb2b7895a7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:15.036803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3580fa00-9a53-480e-8b7d-54cb2b7895a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:15.037872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.040574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.041238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.072350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:15.073898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:15.138584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:15.146122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1009/2017] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:15.148370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.148667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.149276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.174847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:15.176258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:15.193255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1010/2018] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:15.197100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.198122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1009/2019] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:15.208848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dccb1-146f-4108-a6d4-c0827eb77f99 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.210916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.212422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:15.216166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.216992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.217129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.217423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.218994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:15.219315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.220968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.235218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1011/2020] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:46:15.239433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.258565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1a59-ce05-4f6d-9bfc-b8f808d5ecd9 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.269940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.270427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.270794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.271152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.271941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.273955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.293987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb2a67-7be7-4e30-bf45-e5f06d2bbbbf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.298233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.298813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.299102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.299387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.320745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.322186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1012/2021] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:15 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:15.323099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.323236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.340130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1010/2022] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:15.401531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:15.424791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05890-d9f7-4baa-b5cc-0cc1d02af404 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.439292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.439979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.440578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.440578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.441230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.447488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.488146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1013/2023] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:15 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:15.492688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.516858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdee3-495a-47a6-b9a2-98a9ba231b91 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.531750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.532771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.533801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.534866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.536837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.538501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.575446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1011/2024] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:15.579958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.597793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49d40-9add-4d8a-910d-5f0995b05cb2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.607563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04940eb5-eb1b-4f5a-8457-63043aa1fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.609077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04940eb5-eb1b-4f5a-8457-63043aa1fef3 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.609506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04940eb5-eb1b-4f5a-8457-63043aa1fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.610481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04940eb5-eb1b-4f5a-8457-63043aa1fef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.629270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04940eb5-eb1b-4f5a-8457-63043aa1fef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.631060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04940eb5-eb1b-4f5a-8457-63043aa1fef3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.661829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1014/2025] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:15.662824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.695750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dff882-3ee4-47d1-9c03-e18cc3be79a3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:15.706684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:15.708246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.708606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.709021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] PATH_INFO: `/v3/projects/2594a36115944f9d80c8e99c996707a6/users/34874bb658904b1285b7dcaf175b4c0d/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.760539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2594a36115944f9d80c8e99c996707a6, user_id=34874bb658904b1285b7dcaf175b4c0d, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:15.763594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:15.792412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1012/2026] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:15 2022] PUT /identity/v3/projects/2594a36115944f9d80c8e99c996707a6/users/34874bb658904b1285b7dcaf175b4c0d/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:15.803911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:15.804209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:15.804522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:15.876651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] MFA Rules not processed for user `34874bb658904b1285b7dcaf175b4c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:15.878325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:15.931564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:15.933446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.018295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1015/2027] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:16.033443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.035348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.096055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edccd7f-d9dd-40a6-87ee-c496b06b261d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.104580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.105955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.106444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.107700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] PATH_INFO: `/v3/projects/ec89f8007cac476a954fdfd410a10af5` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.110119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec89f8007cac476a954fdfd410a10af5)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.112278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.136962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43255653-a55d-4595-8677-5f4b433eebc6 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.141536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.142194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.142536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.142816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.158951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.161372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.179748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1016/2028] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:16.194099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:16.206053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec89f8007cac476a954fdfd410a10af5', 'request_id': 'req-a1a36377-fc17-4e36-9f48-5b4dd4882c35'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.207185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.213639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec89f8007cac476a954fdfd410a10af5', 'request_id': 'req-a1a36377-fc17-4e36-9f48-5b4dd4882c35'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.222453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec89f8007cac476a954fdfd410a10af5', 'request_id': 'req-a1a36377-fc17-4e36-9f48-5b4dd4882c35'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.224392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028729c-2f15-4de1-a8d7-c88408fb1b6d service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.244988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] The token cache is being invalidate because project ec89f8007cac476a954fdfd410a10af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:16.245305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.245950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1a36377-fc17-4e36-9f48-5b4dd4882c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.247891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1013/2029] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:15 2022] DELETE /identity/v3/projects/ec89f8007cac476a954fdfd410a10af5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:16.253370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf089cb-46cc-4645-8e5d-57bdf5e3eb5a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.253594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf089cb-46cc-4645-8e5d-57bdf5e3eb5a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.253882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf089cb-46cc-4645-8e5d-57bdf5e3eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.276543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-edf089cb-46cc-4645-8e5d-57bdf5e3eb5a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:16.277813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-edf089cb-46cc-4645-8e5d-57bdf5e3eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.305406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:16.313726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.315351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.315818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.316259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] PATH_INFO: `/v3/users/34874bb658904b1285b7dcaf175b4c0d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.319553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34874bb658904b1285b7dcaf175b4c0d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.322708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.369558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1014/2030] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:16.371656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.371985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.372289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.392802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34874bb658904b1285b7dcaf175b4c0d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.393030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:16.393493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34874bb658904b1285b7dcaf175b4c0d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.394322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.404890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34874bb658904b1285b7dcaf175b4c0d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.406539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1015/2031] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:16.407216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34874bb658904b1285b7dcaf175b4c0d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.410760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.419692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-f84560c6-8064-4aea-a350-019e06539431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34874bb658904b1285b7dcaf175b4c0d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:16.430135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cb7c0-a491-4392-ab43-fdc619b988e3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.435950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.436962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.437480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.437641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.438421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:16.438746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.440669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.456244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1017/2032] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:16 2022] DELETE /identity/v3/users/34874bb658904b1285b7dcaf175b4c0d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:16.457957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1016/2033] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:16.460174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.460174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.460174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.470856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.474403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.488262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51c03-1d7d-4f53-8ee6-82bf808723e7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.492041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:16.493366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.566150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.566874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.567166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.567544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.569710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.569855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1018/2034] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:16.572012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.583066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.585776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.611447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1017/2035] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:16.615522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.662127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f44c-4d24-44ae-a606-594eda30f7fc None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.674518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:16.699849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:16.704283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70c13-c8ff-4569-b4ca-335d267b4834 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.709537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.710280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.710598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.710883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.711586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.713566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.722655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.723644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.723973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.724264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.733881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1018/2036] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:16.734681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.736216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.738417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.747259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1019/2037] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:16.750894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431973-ba07-4a4c-9bfa-72cc086c6157 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.755512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.756179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.756465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.756745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.757482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.759145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.769912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1019/2038] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:16.773898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.783613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82561c6-5598-4c09-a7c1-9d0e4ccd7f32 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.788631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21ad2-52d2-4143-9b20-7d2d76ebf421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.789408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21ad2-52d2-4143-9b20-7d2d76ebf421 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.789694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21ad2-52d2-4143-9b20-7d2d76ebf421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.789987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21ad2-52d2-4143-9b20-7d2d76ebf421 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.790747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21ad2-52d2-4143-9b20-7d2d76ebf421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.792354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21ad2-52d2-4143-9b20-7d2d76ebf421 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.803926 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1020/2039] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:16.808415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:16.820699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7879d-9ab4-49fb-ad9c-86127715ed31 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:16.825338 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:16.826225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.826559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.826838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] PATH_INFO: `/v3/projects/c42396166a95434b962717d5e35520f8/users/19d57f2d32704ac79ad0dabca797c57e/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.842958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42396166a95434b962717d5e35520f8, user_id=19d57f2d32704ac79ad0dabca797c57e, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:16.845976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:16.859842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1020/2040] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:16 2022] PUT /identity/v3/projects/c42396166a95434b962717d5e35520f8/users/19d57f2d32704ac79ad0dabca797c57e/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:16.870844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:16.871225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:16.871587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:16.903880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] MFA Rules not processed for user `19d57f2d32704ac79ad0dabca797c57e`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:16.905672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:16.978235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1021/2041] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:16.982799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.033295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.035502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:17.060627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c34e-1cf2-44c9-81c2-cd2c0c3bad77 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.074270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.075246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.075415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.075691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.076406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.079307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.109556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1021/2042] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:17.113326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.126023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32830c-0473-4c41-be79-ff4624b6186f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.188971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599654d-c5c8-41d8-a40a-13f1135c8943 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.195298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.195980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.196264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.196540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.197246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.198746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.199243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.199766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.200055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.200337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] PATH_INFO: `/v3/projects/2594a36115944f9d80c8e99c996707a6` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.201709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2594a36115944f9d80c8e99c996707a6)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.204755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.208375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:17.233290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1022/2043] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:17.239408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.250411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eeed4-630a-47d3-b804-0eb9a428ee8f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.260063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.260740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.261028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.261306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.262062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.264091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.266046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:17.279220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1023/2044] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:17.283256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.297521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24041af-de50-410f-ba2c-aa784022fc12 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.301093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2594a36115944f9d80c8e99c996707a6', 'request_id': 'req-a71c878f-8e04-4ef0-8a00-4808847487aa'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:17.310553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2594a36115944f9d80c8e99c996707a6', 'request_id': 'req-a71c878f-8e04-4ef0-8a00-4808847487aa'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:17.320447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2594a36115944f9d80c8e99c996707a6', 'request_id': 'req-a71c878f-8e04-4ef0-8a00-4808847487aa'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:17.334516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] The token cache is being invalidate because project 2594a36115944f9d80c8e99c996707a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:17.334871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:17.335561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a71c878f-8e04-4ef0-8a00-4808847487aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:17.340723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1022/2045] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:17 2022] DELETE /identity/v3/projects/2594a36115944f9d80c8e99c996707a6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:17.343915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc415fc-9b92-422a-9034-34e7c9627793 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.344210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc415fc-9b92-422a-9034-34e7c9627793 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.344551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc415fc-9b92-422a-9034-34e7c9627793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.380276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7dc415fc-9b92-422a-9034-34e7c9627793 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:17.382672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7dc415fc-9b92-422a-9034-34e7c9627793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:17.396662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.397345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.397633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.397915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.398697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.400287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.401122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1023/2046] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:17.410564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.410855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.411134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.414938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1024/2047] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:17.415979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.417668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:17.429450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:17.430708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:17.431568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95677d-fa39-45c2-9ec9-4717024809d1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.436280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.437332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.437615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.437894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] PATH_INFO: `/v3/projects/fe8e6c5f0e2c46a1a003fcb280226b11/users/4bf9560db7e245ea97cb1874aaf6b07c/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.439236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1024/2048] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:17.443499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.453862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889a77-2a6f-4d12-8d87-894756cf3510 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.454143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8e6c5f0e2c46a1a003fcb280226b11, user_id=4bf9560db7e245ea97cb1874aaf6b07c, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.456965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.458694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.459356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.459641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.459938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.460667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:17.460984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.462958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da084aa-3ffd-428c-a48f-2dd1597a1bcb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.471006 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1025/2049] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:17 2022] PUT /identity/v3/projects/fe8e6c5f0e2c46a1a003fcb280226b11/users/4bf9560db7e245ea97cb1874aaf6b07c/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:17.490144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1025/2050] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:46:17.493316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.556041 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.556336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.556626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.572190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a17ed-831d-47b1-aa5f-c14505dd7f47 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.577556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.578376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.578578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.578860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.579686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.581696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.585230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] MFA Rules not processed for user `4bf9560db7e245ea97cb1874aaf6b07c`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:17.586678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:17.613525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1026/2051] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:17.615044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.663201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1026/2052] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:17.668379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.683563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1215c-53fd-43ec-aaff-39f35296408f None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.698703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:17.712770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe6e4-ef26-4b1c-8381-c1e7b7202f06 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.717641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.718471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.718897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.719500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.720308 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.722829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.743518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1027/2053] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:17.746346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:17.747299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.756950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.757852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.760881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.761397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.762347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.762601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b6fd2-5804-4c5c-8733-11d58ebd3378 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.764499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.767668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.768329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.768633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.768884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.769776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.771271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.781731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1028/2054] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:17.785934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.795417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1027/2055] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:17.796808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93f5c-4240-4f1b-b39e-ab09cca35009 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.799980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.862198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.862909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.863195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.863474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.864212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.865931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.866036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466850-f9a8-471a-9246-e8a716747eb2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.870809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.871475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.871758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.872031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.872802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.875376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.876623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1029/2056] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:17.880648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.890420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2945a-8c9d-4f0d-bbc9-ae2ebc48c4cf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.895127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.895523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1028/2057] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:17.898981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.899288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.899400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.899583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] PATH_INFO: `/v3/projects/56d7092eca6f495fbb19ed5c37bb4b93/users/13cdabdaf85842f1a20b2aab062255d1/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.909455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ff01-68c1-4874-8fa3-0f515dc4deee admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:17.916159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d7092eca6f495fbb19ed5c37bb4b93, user_id=13cdabdaf85842f1a20b2aab062255d1, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.918707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331b70f-7c58-4b9d-b7b7-b90e5a3ee816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:17.919072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.919385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331b70f-7c58-4b9d-b7b7-b90e5a3ee816 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.919666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331b70f-7c58-4b9d-b7b7-b90e5a3ee816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.919946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331b70f-7c58-4b9d-b7b7-b90e5a3ee816 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.921355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331b70f-7c58-4b9d-b7b7-b90e5a3ee816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:17.923137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331b70f-7c58-4b9d-b7b7-b90e5a3ee816 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:17.933114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1030/2058] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:17 2022] PUT /identity/v3/projects/56d7092eca6f495fbb19ed5c37bb4b93/users/13cdabdaf85842f1a20b2aab062255d1/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:17.933550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1029/2059] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:17.939495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:17.944082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:17.944381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:17.944667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:17.972492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] MFA Rules not processed for user `13cdabdaf85842f1a20b2aab062255d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:17.973736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:18.006691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df5c1d-e063-427e-b72a-edbeab3f20f5 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:18.016692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:18.017598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:18.017877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:18.018155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] PATH_INFO: `/v3/projects/dc07ffaa5fdb4bc2b2ee70fb3aae14cf/users/c75aedddc29c4aacb713b19db76dda87/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:18.034593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07ffaa5fdb4bc2b2ee70fb3aae14cf, user_id=c75aedddc29c4aacb713b19db76dda87, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:18.037541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:18.041132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1030/2060] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:18.052441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1031/2061] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:17 2022] PUT /identity/v3/projects/dc07ffaa5fdb4bc2b2ee70fb3aae14cf/users/c75aedddc29c4aacb713b19db76dda87/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:18.052828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:18.054274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:18.056105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:18.087709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:18.111577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:18.122059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c547cf-5c11-4264-95e5-40a255bf6e75 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:18.127652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:18.128361 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:18.128746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:18.129030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:18.129789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:18.131492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:18.138082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce644f13-538b-4fc4-9900-47e400765f51 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:18.142512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1032/2062] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:18.146759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:18.157495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86a0e-202b-4499-842a-88c74acce488 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:18.162319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25147-b2d0-4ba5-a777-9240ddcb843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:18.163295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25147-b2d0-4ba5-a777-9240ddcb843d admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:18.163576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25147-b2d0-4ba5-a777-9240ddcb843d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:18.163851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25147-b2d0-4ba5-a777-9240ddcb843d admin admin] PATH_INFO: `/v3/projects/dc07ffaa5fdb4bc2b2ee70fb3aae14cf/users/c75aedddc29c4aacb713b19db76dda87/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:18.165797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e25147-b2d0-4ba5-a777-9240ddcb843d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07ffaa5fdb4bc2b2ee70fb3aae14cf, user_id=c75aedddc29c4aacb713b19db76dda87, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:18.168435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e25147-b2d0-4ba5-a777-9240ddcb843d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:18.178682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1033/2063] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:18 2022] PUT /identity/v3/projects/dc07ffaa5fdb4bc2b2ee70fb3aae14cf/users/c75aedddc29c4aacb713b19db76dda87/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:18.189269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:18.189561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:18.189839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:18.194085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:18.194773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:18.195065 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:18.195349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:18.216651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] MFA Rules not processed for user `c75aedddc29c4aacb713b19db76dda87`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:18.218081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:18.258957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:18.260498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:18.273348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1031/2064] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:18.296149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1034/2065] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:18.307968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:18.309640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:18.377171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f1333-05db-464e-bb64-a8c10705a6bd service glance] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:18.430163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:18.430865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:18.431525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:18.431643 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:18.433627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:18.445154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:18.515964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:18.517425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:18.530624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1032/2066] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:20.173986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:20.184211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4b37f-9c3b-4a23-9d9e-46c69bfe8cce None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:20.189125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c3a0-424d-44c2-994f-eb8e1ef25da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:20.189788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c3a0-424d-44c2-994f-eb8e1ef25da3 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:20.190074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c3a0-424d-44c2-994f-eb8e1ef25da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:20.190365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c3a0-424d-44c2-994f-eb8e1ef25da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:20.262321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1c3a0-424d-44c2-994f-eb8e1ef25da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:20.265163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1c3a0-424d-44c2-994f-eb8e1ef25da3 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:20.277891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1035/2067] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:21.017602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:21.017602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:21.028180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd5957-cd97-4b04-9396-2189ddd8971b service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:21.032924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ba99-7663-40b3-afd1-078d69f9156c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:21.034106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ba99-7663-40b3-afd1-078d69f9156c service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:21.034549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ba99-7663-40b3-afd1-078d69f9156c service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:21.034870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ba99-7663-40b3-afd1-078d69f9156c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:21.047919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1ba99-7663-40b3-afd1-078d69f9156c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:21.049349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1ba99-7663-40b3-afd1-078d69f9156c service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:21.058973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1033/2068] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:22.865300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8993-b860-40c5-bc1b-51070cf64ff5 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:22.865805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8993-b860-40c5-bc1b-51070cf64ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:22.865897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8993-b860-40c5-bc1b-51070cf64ff5 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:22.867305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1036/2069] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:46:22.883093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3d17-50fd-43c2-a2c4-8ca0b6cf7b95 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:22.883606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3d17-50fd-43c2-a2c4-8ca0b6cf7b95 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:22.883697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3d17-50fd-43c2-a2c4-8ca0b6cf7b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:22.903919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ea7f3d17-50fd-43c2-a2c4-8ca0b6cf7b95 None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:22.914453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ea7f3d17-50fd-43c2-a2c4-8ca0b6cf7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:22.993668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1034/2070] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:46:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:23.005626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8993-b860-40c5-bc1b-51070cf64ff5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:23.007564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f4ee8993-b860-40c5-bc1b-51070cf64ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:23.024462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8993-b860-40c5-bc1b-51070cf64ff5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:23.030471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5d2b9-4377-4b7f-9098-273cffe39896 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:23.031202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d2b9-4377-4b7f-9098-273cffe39896 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:23.031566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d2b9-4377-4b7f-9098-273cffe39896 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:23.031987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d2b9-4377-4b7f-9098-273cffe39896 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:23.042284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5d2b9-4377-4b7f-9098-273cffe39896 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:23.044135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5d2b9-4377-4b7f-9098-273cffe39896 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:23.066464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1037/2071] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:23.603576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6242-b489-4c46-a7f8-1fa2b63961e5 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:23.603948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6242-b489-4c46-a7f8-1fa2b63961e5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:23.604305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6242-b489-4c46-a7f8-1fa2b63961e5 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:23.605919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1035/2072] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:46:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:46:23.638930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:23.640091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:23.640571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:23.670658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6242-b489-4c46-a7f8-1fa2b63961e5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:23.676057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] MFA Rules not processed for user `f3a1ee469cae4cf8a166bc259d3e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:23.676251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-624d6242-b489-4c46-a7f8-1fa2b63961e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:23.677283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:23.696820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1038/2073] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:23.711254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:23.722974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8371-0bac-4efe-bbf4-033553cc62e1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:23.731628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:23.732490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:23.732714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:23.733301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:23.745652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:23.747762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:23.759127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:23.767431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1039/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:23.771543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6242-b489-4c46-a7f8-1fa2b63961e5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:23.776492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:23.777456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:23.777822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:23.778178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] PATH_INFO: `/v3/users/19d17df3bf94409296ef5f133494ab39` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:23.781068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d17df3bf94409296ef5f133494ab39)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:23.784042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:23.837613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:23.850720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d17df3bf94409296ef5f133494ab39'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:23.851466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d17df3bf94409296ef5f133494ab39'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:23.862653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d17df3bf94409296ef5f133494ab39'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:23.863544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d17df3bf94409296ef5f133494ab39'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:23.873500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d17df3bf94409296ef5f133494ab39'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:23.901440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1036/2075] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:23 2022] DELETE /identity/v3/users/19d17df3bf94409296ef5f133494ab39 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:24.119803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:24.147382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a27b-95b5-4f41-81a7-aeadaad69449 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:24.247061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:24.248266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:24.248937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:24.249362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] PATH_INFO: `/v3/projects/16b39ef7e23f47ac94133f827e3b4a11` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:24.250857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b39ef7e23f47ac94133f827e3b4a11)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:24.252830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:24.306255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b39ef7e23f47ac94133f827e3b4a11', 'request_id': 'req-f78eca28-4f7f-4ae8-9b72-4a264c30638d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.312406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b39ef7e23f47ac94133f827e3b4a11', 'request_id': 'req-f78eca28-4f7f-4ae8-9b72-4a264c30638d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.318761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b39ef7e23f47ac94133f827e3b4a11', 'request_id': 'req-f78eca28-4f7f-4ae8-9b72-4a264c30638d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.335365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] The token cache is being invalidate because project 16b39ef7e23f47ac94133f827e3b4a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:24.335695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.336952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.341979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1040/2076] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:24 2022] DELETE /identity/v3/projects/16b39ef7e23f47ac94133f827e3b4a11 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:24.345472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:24.346466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:24.362051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4409d9-ba32-44e6-bef1-051cec1d783c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:24.426264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:24.427215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:24.427499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:24.427777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] PATH_INFO: `/v3/users/c0f3f116186f4129b8572887b3a25501` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:24.428978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f3f116186f4129b8572887b3a25501)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:24.431218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:24.504606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f3f116186f4129b8572887b3a25501'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.505375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f3f116186f4129b8572887b3a25501'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.520885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f3f116186f4129b8572887b3a25501'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.522864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f3f116186f4129b8572887b3a25501'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.534775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f3f116186f4129b8572887b3a25501'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:24.567502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1037/2077] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:24 2022] DELETE /identity/v3/users/c0f3f116186f4129b8572887b3a25501 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:24.845275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:24.847251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:24.869402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eca28-4f7f-4ae8-9b72-4a264c30638d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:24.940033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:24.940903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:24.941198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:24.941477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] PATH_INFO: `/v3/projects/2c03f00770f34ddcb558bd1eb990cbf2` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:24.942716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c03f00770f34ddcb558bd1eb990cbf2)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:24.944682 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:24.998554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:25.017727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c03f00770f34ddcb558bd1eb990cbf2', 'request_id': 'req-57238de7-9b34-450d-9e39-edee322c307b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.023356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c03f00770f34ddcb558bd1eb990cbf2', 'request_id': 'req-57238de7-9b34-450d-9e39-edee322c307b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.030537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c03f00770f34ddcb558bd1eb990cbf2', 'request_id': 'req-57238de7-9b34-450d-9e39-edee322c307b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.038911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.040470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.048233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] The token cache is being invalidate because project 2c03f00770f34ddcb558bd1eb990cbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:25.048527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.049185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-57238de7-9b34-450d-9e39-edee322c307b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.050811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1041/2078] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:24 2022] DELETE /identity/v3/projects/2c03f00770f34ddcb558bd1eb990cbf2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:25.055639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217433-2c1c-42eb-bd31-d9c44af17f52 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.055935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217433-2c1c-42eb-bd31-d9c44af17f52 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.056222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217433-2c1c-42eb-bd31-d9c44af17f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.057262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c989-de75-4350-aca5-61921bb35628 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.074323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-21217433-2c1c-42eb-bd31-d9c44af17f52 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:25.075563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-21217433-2c1c-42eb-bd31-d9c44af17f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.088329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:25.118525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.119781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.120177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.120559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] PATH_INFO: `/v3/users/19d57f2d32704ac79ad0dabca797c57e` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.129551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d57f2d32704ac79ad0dabca797c57e)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.131911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.142174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1042/2079] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:25.150894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.151381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.151792 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.176660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:25.178404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.186762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1043/2080] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:25.190174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d57f2d32704ac79ad0dabca797c57e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.191255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.192775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d57f2d32704ac79ad0dabca797c57e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.203460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8029f0-02ee-4303-b1a6-210cc34b09cc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.203729 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d57f2d32704ac79ad0dabca797c57e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.204423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d57f2d32704ac79ad0dabca797c57e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.210388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.211374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.211725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.212064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.213169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:25.213557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.213976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8f64f2a7-48e8-462d-87a4-f625a32dcab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d57f2d32704ac79ad0dabca797c57e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:25.215475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.243840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1044/2081] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:46:25.244234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1038/2082] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:25 2022] DELETE /identity/v3/users/19d57f2d32704ac79ad0dabca797c57e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:25.245265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.246722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.247172 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.247499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.247606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.264521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa816f3-361a-438c-8156-1cfcc562bdbd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.270463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:25.272263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.349131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.349887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.350398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.350911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.351601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.354202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.380970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1039/2083] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:25.393791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.395533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.397981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1045/2084] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:25 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:25.402055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.439024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:25.467535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f55c-4cf4-4aeb-8eea-fa5ec7cbad43 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.476043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:25.496925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d9b4-8ca9-443f-911c-041e797b6727 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.503554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.504650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.504940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.505259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.505974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.507957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.528979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1046/2085] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:25 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:25.532751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.533395 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.533688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.533788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.533975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.543992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1a0e-8e83-47e0-9f36-f9b0c1f416c7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.544574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.546682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.549330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.549983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.550272 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.550584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.551315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.553111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.556927 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1040/2086] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:25.565117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1047/2087] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:25.569762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.579711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07811f43-dfe8-4dfb-abe6-7266ce36863a service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.584327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52779-ed46-4330-b234-84d0e2f977da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.584991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52779-ed46-4330-b234-84d0e2f977da admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.585283 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52779-ed46-4330-b234-84d0e2f977da admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.585596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52779-ed46-4330-b234-84d0e2f977da admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.586324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52779-ed46-4330-b234-84d0e2f977da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.587954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52779-ed46-4330-b234-84d0e2f977da admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.598570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1041/2088] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:25.602877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.614120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcac4a3-79a2-43de-a03f-8aa772076411 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.620884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.620884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.620884 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.621171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] PATH_INFO: `/v3/projects/2e72dba2a94640f7b06f07ceaa686953/users/884519370e244dcf80883222c356b619/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.645726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e72dba2a94640f7b06f07ceaa686953, user_id=884519370e244dcf80883222c356b619, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.648765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.662676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1048/2089] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:25 2022] PUT /identity/v3/projects/2e72dba2a94640f7b06f07ceaa686953/users/884519370e244dcf80883222c356b619/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:25.673413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a581-4296-49c6-9e52-09d974468feb None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.673707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a581-4296-49c6-9e52-09d974468feb None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.674058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a581-4296-49c6-9e52-09d974468feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.703194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d415a581-4296-49c6-9e52-09d974468feb None None] MFA Rules not processed for user `884519370e244dcf80883222c356b619`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:25.704427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d415a581-4296-49c6-9e52-09d974468feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.782523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1042/2090] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:25.797040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.799323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.872641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb06f-e6fe-45cf-b67e-5565f6e25ee3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.877409 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415a581-4296-49c6-9e52-09d974468feb None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.879000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d415a581-4296-49c6-9e52-09d974468feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:25.882859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.883999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.884287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.884572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:25.900967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:25.902613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:25.922397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1049/2091] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:25.944074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:25.990299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415a581-4296-49c6-9e52-09d974468feb None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:25.996068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:25.996943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:25.997310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:25.997518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] PATH_INFO: `/v3/projects/c42396166a95434b962717d5e35520f8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.002455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42396166a95434b962717d5e35520f8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:26.004421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:26.019154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3cf2-39de-4391-a00c-5f52e03b87d3 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:26.023856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:26.024833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:26.025208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:26.025569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] PATH_INFO: `/v3/users/884519370e244dcf80883222c356b619` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.026900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884519370e244dcf80883222c356b619)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:26.028895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:26.040870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:26.056974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42396166a95434b962717d5e35520f8', 'request_id': 'req-ff3f7408-03a2-46fd-8047-c102963ee698'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.061932 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:26.064348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42396166a95434b962717d5e35520f8', 'request_id': 'req-ff3f7408-03a2-46fd-8047-c102963ee698'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.072196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42396166a95434b962717d5e35520f8', 'request_id': 'req-ff3f7408-03a2-46fd-8047-c102963ee698'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.084285 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] The token cache is being invalidate because project c42396166a95434b962717d5e35520f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:26.084581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.084939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884519370e244dcf80883222c356b619'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.085378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.086853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1043/2092] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:25 2022] DELETE /identity/v3/projects/c42396166a95434b962717d5e35520f8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:26.092222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:26.094866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:26.102935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884519370e244dcf80883222c356b619'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.103665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884519370e244dcf80883222c356b619'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.104299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884519370e244dcf80883222c356b619'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.112027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d5af9489-e161-4987-b104-cdc9890c9b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884519370e244dcf80883222c356b619'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.125667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1050/2093] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:25 2022] DELETE /identity/v3/users/884519370e244dcf80883222c356b619 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:26.130077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:26.130418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:26.130710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.150520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:26.151821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:26.163787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7408-03a2-46fd-8047-c102963ee698 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:26.219527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1051/2094] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:26.226235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:26.227212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:26.227476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:26.227749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] PATH_INFO: `/v3/users/4bf9560db7e245ea97cb1874aaf6b07c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.229096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf9560db7e245ea97cb1874aaf6b07c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:26.230131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:26.231072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:26.231853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:26.292679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf9560db7e245ea97cb1874aaf6b07c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.294178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf9560db7e245ea97cb1874aaf6b07c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.297580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0fd7f-9032-4d46-a98c-776e87b76755 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:26.301644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:26.302481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:26.302793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf9560db7e245ea97cb1874aaf6b07c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.303044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:26.303455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.303766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf9560db7e245ea97cb1874aaf6b07c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.305657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:26.313518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf9560db7e245ea97cb1874aaf6b07c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:26.319470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:26.320059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:26.321081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:26.338214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1052/2095] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:26.344024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1044/2096] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:26 2022] DELETE /identity/v3/users/4bf9560db7e245ea97cb1874aaf6b07c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:26.824849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:26.826405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:26.844992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:26.846712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:26.856824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f893101-48f1-4239-acc8-6e893e6106b5 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:26.909526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:26.925902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:26.926805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:26.927087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:26.927416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] PATH_INFO: `/v3/projects/2e72dba2a94640f7b06f07ceaa686953` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.928626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e72dba2a94640f7b06f07ceaa686953)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:26.930589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:26.946771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22a1cd-a5f9-47fb-b49b-879f81d682c7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:26.954472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:26.954472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:26.954472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:26.954874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] PATH_INFO: `/v3/projects/fe8e6c5f0e2c46a1a003fcb280226b11` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:26.955992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8e6c5f0e2c46a1a003fcb280226b11)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:26.957947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:26.993918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e72dba2a94640f7b06f07ceaa686953', 'request_id': 'req-07d76e60-fe7c-4144-a029-e5ad87d5657a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.000891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e72dba2a94640f7b06f07ceaa686953', 'request_id': 'req-07d76e60-fe7c-4144-a029-e5ad87d5657a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.007488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e72dba2a94640f7b06f07ceaa686953', 'request_id': 'req-07d76e60-fe7c-4144-a029-e5ad87d5657a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.023106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] The token cache is being invalidate because project 2e72dba2a94640f7b06f07ceaa686953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:27.023399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.023519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8e6c5f0e2c46a1a003fcb280226b11', 'request_id': 'req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.024045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-07d76e60-fe7c-4144-a029-e5ad87d5657a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.025966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1053/2097] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:26 2022] DELETE /identity/v3/projects/2e72dba2a94640f7b06f07ceaa686953 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:27.031156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0b833-6c16-42f1-9c5f-3fae169338c6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.031320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0b833-6c16-42f1-9c5f-3fae169338c6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.031744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0b833-6c16-42f1-9c5f-3fae169338c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.034581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8e6c5f0e2c46a1a003fcb280226b11', 'request_id': 'req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.042932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8e6c5f0e2c46a1a003fcb280226b11', 'request_id': 'req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.053598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-33d0b833-6c16-42f1-9c5f-3fae169338c6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:27.055025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-33d0b833-6c16-42f1-9c5f-3fae169338c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.059198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] The token cache is being invalidate because project fe8e6c5f0e2c46a1a003fcb280226b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:27.059636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.060431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.062859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1045/2098] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:26 2022] DELETE /identity/v3/projects/fe8e6c5f0e2c46a1a003fcb280226b11 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:27.066679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.068170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.139674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc7ee-b1dd-4058-bc7a-601ebd2eb3a7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.146616 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1054/2099] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:27.148992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.149345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.149640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.156766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.159150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.159622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.159914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] PATH_INFO: `/v3/users/c75aedddc29c4aacb713b19db76dda87` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.161494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75aedddc29c4aacb713b19db76dda87)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.163760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.175525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:27.176747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.185164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1055/2100] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:27.187783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:27.191431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.203056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc7a8-b406-4b60-826e-c78884edd765 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.209148 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.209820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.210103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.210412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.211153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:27.211467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.213094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.223837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75aedddc29c4aacb713b19db76dda87'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.224541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75aedddc29c4aacb713b19db76dda87'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.225381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1056/2101] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:27.229729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.231709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75aedddc29c4aacb713b19db76dda87'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.232384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75aedddc29c4aacb713b19db76dda87'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.241640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75aedddc29c4aacb713b19db76dda87'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.244112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56def286-2aff-4150-8ba8-3601366e3438 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.250296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.251003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.251294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.251583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.252303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.254265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.268363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1046/2102] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:27 2022] DELETE /identity/v3/users/c75aedddc29c4aacb713b19db76dda87 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:27.288660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1057/2103] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:27.289272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.290847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.372234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32318-b7a3-4306-9bae-8ab59d6b1d16 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.437005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.437719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.438005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.438286 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.439114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.441109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.466404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1047/2104] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:27.468107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.482674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a80c-7347-4c5a-b38e-f39cad758464 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.488594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.489354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.489641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.489917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.490683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.492273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.502985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1058/2105] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:27.506935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.518962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efdb30-3256-47a7-ade0-a96c17bc13e4 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.525559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.526305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.526699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.526944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.527979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.529827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.541611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1048/2106] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:27.546632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.556735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981d20-0d78-467e-9a61-2904054a80af admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.562225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe650cd0-1dd5-4b48-ba6e-247df51e6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.563324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650cd0-1dd5-4b48-ba6e-247df51e6a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.563610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650cd0-1dd5-4b48-ba6e-247df51e6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.563890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650cd0-1dd5-4b48-ba6e-247df51e6a00 admin admin] PATH_INFO: `/v3/projects/78626c17863c4f28aa4f4f24ed14eb9d/users/caa89bf594b64422866601ffbd2ab956/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.581535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe650cd0-1dd5-4b48-ba6e-247df51e6a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78626c17863c4f28aa4f4f24ed14eb9d, user_id=caa89bf594b64422866601ffbd2ab956, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.584889 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe650cd0-1dd5-4b48-ba6e-247df51e6a00 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.595419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:27.595584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.600855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.606459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1059/2107] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:27 2022] PUT /identity/v3/projects/78626c17863c4f28aa4f4f24ed14eb9d/users/caa89bf594b64422866601ffbd2ab956/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:27.618968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.623152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e3c1-6e89-4338-b208-491d04d49645 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.627080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.627852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.642150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:27.656369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] MFA Rules not processed for user `caa89bf594b64422866601ffbd2ab956`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:27.657709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.694552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.695427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.695765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.696057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] PATH_INFO: `/v3/projects/dc07ffaa5fdb4bc2b2ee70fb3aae14cf` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.697256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc07ffaa5fdb4bc2b2ee70fb3aae14cf)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.699346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.734095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1060/2108] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:27.738628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.750699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445578a-a068-4173-990f-008e59a0ca2f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.761797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc07ffaa5fdb4bc2b2ee70fb3aae14cf', 'request_id': 'req-01532d3b-466e-4201-95ce-6a1211039346'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.770316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc07ffaa5fdb4bc2b2ee70fb3aae14cf', 'request_id': 'req-01532d3b-466e-4201-95ce-6a1211039346'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.777532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc07ffaa5fdb4bc2b2ee70fb3aae14cf', 'request_id': 'req-01532d3b-466e-4201-95ce-6a1211039346'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.789338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] The token cache is being invalidate because project dc07ffaa5fdb4bc2b2ee70fb3aae14cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:27.789628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.790336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-01532d3b-466e-4201-95ce-6a1211039346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:27.791937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1049/2109] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:27 2022] DELETE /identity/v3/projects/dc07ffaa5fdb4bc2b2ee70fb3aae14cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:27.797076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485cc6b-e96f-43ff-b4ac-49c82fca307e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.797371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485cc6b-e96f-43ff-b4ac-49c82fca307e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.797655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485cc6b-e96f-43ff-b4ac-49c82fca307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.817319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e485cc6b-e96f-43ff-b4ac-49c82fca307e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:27.818654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.818809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e485cc6b-e96f-43ff-b4ac-49c82fca307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.819328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.819619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.819899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.820596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.822536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.826997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1050/2110] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:27.834308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.834701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.834996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.851243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1061/2111] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:27.855153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.856700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.860990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:27.862172 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:27.928605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1051/2112] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:27.930720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cc8c5-211b-400a-b5d5-71ab519f99b4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.932860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.935672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.936968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.937333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.937617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.938311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.940403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.946421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a90c-d0f8-4152-8fe2-ce7ed427efe4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.953804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.954628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.954939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.955186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.959739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:27.960466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.962429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.963097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1062/2113] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:27.966879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.974381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:27.985209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1052/2114] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:27.985297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5e0da-e364-4a80-b9ac-2d14ed6abfb6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:27.985378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:27.988103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:27.988774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:27.989340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:27.989628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:27.990643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:27.993126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:27.995548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e84a8-0c99-4ea6-ab07-2525e089852b admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.001133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.001653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.001939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.002217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.002942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.004830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.009495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1063/2115] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:28.011810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.024492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb72b9-a171-4e9b-b05a-e0ecc5f17ea8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.032559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.037344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.037344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.037344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.037915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.039722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.046438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1053/2116] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:27 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:28.050052 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.056447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1064/2117] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:28.060584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.061983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:28.072604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818da426-7485-4ecd-a7b2-2491b95a250b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.130204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fdd01-aae8-4ed1-b338-bee0cf107c4f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.135307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.136001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.136288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.136570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.137483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.140103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.147671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5aba6-718a-4ba3-8882-cdb087d86202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.148614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5aba6-718a-4ba3-8882-cdb087d86202 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.148902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5aba6-718a-4ba3-8882-cdb087d86202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.149299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5aba6-718a-4ba3-8882-cdb087d86202 admin admin] PATH_INFO: `/v3/projects/81ef5e37dab845df8c4ea3f5abbaa936/users/a23c43cfca6b44c493976d1a06782f45/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.168570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1054/2118] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:28 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:28.173007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5aba6-718a-4ba3-8882-cdb087d86202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ef5e37dab845df8c4ea3f5abbaa936, user_id=a23c43cfca6b44c493976d1a06782f45, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.173616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.176103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5aba6-718a-4ba3-8882-cdb087d86202 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.187791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8ca0-f57e-4768-b7fb-af917e203b00 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.195256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1065/2119] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:28 2022] PUT /identity/v3/projects/81ef5e37dab845df8c4ea3f5abbaa936/users/a23c43cfca6b44c493976d1a06782f45/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:28.205715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.206008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.206280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.252704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] MFA Rules not processed for user `a23c43cfca6b44c493976d1a06782f45`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:28.254413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:28.278664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.279965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.280850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.281201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.282081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.284126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.300011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1055/2120] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:28.303625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.328787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f0997-81dc-4cd8-bbfa-f44f3162f8a1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.347755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.349095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.349444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.350231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.351001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.357760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.374419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1066/2121] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:28.377949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.380784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1056/2122] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:28.388825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.403718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a75ee-579a-4e32-9fda-07dcfaf0b319 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.408648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867d4e-d7d2-4a9b-98ea-9375f712327a admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.409117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.409794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.410092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.410670 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.411370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.413325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.414051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ba5d1-c2fc-4f74-90ca-ff7ad458e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.415058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ba5d1-c2fc-4f74-90ca-ff7ad458e0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.415424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ba5d1-c2fc-4f74-90ca-ff7ad458e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.415769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ba5d1-c2fc-4f74-90ca-ff7ad458e0a0 admin admin] PATH_INFO: `/v3/projects/3864c04174af4b648382ba263b4f7fd8/users/23ab113e16824c88b040c6ab74ff205b/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.436806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ba5d1-c2fc-4f74-90ca-ff7ad458e0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3864c04174af4b648382ba263b4f7fd8, user_id=23ab113e16824c88b040c6ab74ff205b, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.440127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ba5d1-c2fc-4f74-90ca-ff7ad458e0a0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.451448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1067/2123] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:28 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:28.454249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.459213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1057/2124] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:28 2022] PUT /identity/v3/projects/3864c04174af4b648382ba263b4f7fd8/users/23ab113e16824c88b040c6ab74ff205b/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:28.476251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.476575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.476838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.505358 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:28.512450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] MFA Rules not processed for user `23ab113e16824c88b040c6ab74ff205b`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:28.513679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:28.551785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82d8c-70ac-453e-af48-cb7bbff13f1c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.577004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:28.605299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1058/2125] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:28.622271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.622992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.623279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.624346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.624840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.626843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.649852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1068/2126] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:28 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:28.652534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.664250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8621-0096-4112-bdfa-25ffae6575c3 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.670324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.671269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.671711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.672177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.673299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.677408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.692966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1059/2127] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:28.697403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.708101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ce17-4cc6-4dc2-9967-9bf9d901ff77 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.712742 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.713630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.713916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.714193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] PATH_INFO: `/v3/projects/db9800057820445b9ba82b88c19444e8/users/0947bcde7d2f443eb940d82facbdf710/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.729139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9800057820445b9ba82b88c19444e8, user_id=0947bcde7d2f443eb940d82facbdf710, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.731845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.746200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1069/2128] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:28 2022] PUT /identity/v3/projects/db9800057820445b9ba82b88c19444e8/users/0947bcde7d2f443eb940d82facbdf710/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:28.751553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.761521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be8910-b26a-4256-bfd7-d2f1c299b3ff admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.822948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9d09-5291-4313-b973-1ffcc3a28b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.823625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9d09-5291-4313-b973-1ffcc3a28b9a admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.823913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9d09-5291-4313-b973-1ffcc3a28b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.824195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9d09-5291-4313-b973-1ffcc3a28b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.824931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d9d09-5291-4313-b973-1ffcc3a28b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.828199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d9d09-5291-4313-b973-1ffcc3a28b9a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.839154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1060/2129] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:28.843918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:28.854538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99229-3968-4a6c-bfcf-2b3cc434c9cc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:28.860267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:28.861188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.861478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.861760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] PATH_INFO: `/v3/projects/db9800057820445b9ba82b88c19444e8/users/0947bcde7d2f443eb940d82facbdf710/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.863804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9800057820445b9ba82b88c19444e8, user_id=0947bcde7d2f443eb940d82facbdf710, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:28.866487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:28.881465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1070/2130] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:28 2022] PUT /identity/v3/projects/db9800057820445b9ba82b88c19444e8/users/0947bcde7d2f443eb940d82facbdf710/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:28.891932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:28.892224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:28.892508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:28.919631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] MFA Rules not processed for user `0947bcde7d2f443eb940d82facbdf710`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:28.921701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:29.005666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1061/2131] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:29.018290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:29.020386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:29.084234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937c9ba-9f5a-4925-89ec-7937e33f2358 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:29.087851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:29.088480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:29.088762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:29.089044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:29.090898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:29.140782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:29.155484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:29.157069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:29.166423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1071/2132] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:30.758150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:30.770317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193f647-996e-4362-ae10-4a6e2834774b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:30.777777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:30.778490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:30.778798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:30.779069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:30.845079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:30.846901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:30.851306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:30.864733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1062/2133] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:31.522740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:31.533623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a27ac-fe8d-441d-83a1-cf5942780716 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:31.540972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:31.541647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:31.541941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:31.542930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:31.552802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:31.554255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:31.566968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1072/2134] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:32.207716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:32.209352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:32.299551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fcb5e-c5fa-4202-93c6-461966fa0a88 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:32.303963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:32.304958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.305240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.305516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] PATH_INFO: `/v3/users/831d1557afd649518d34d4f970f96674` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:32.306835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831d1557afd649518d34d4f970f96674)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:32.308756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:32.367262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831d1557afd649518d34d4f970f96674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.368075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831d1557afd649518d34d4f970f96674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.375597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831d1557afd649518d34d4f970f96674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.376246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831d1557afd649518d34d4f970f96674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.384398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831d1557afd649518d34d4f970f96674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.403185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1063/2135] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:32 2022] DELETE /identity/v3/users/831d1557afd649518d34d4f970f96674 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:32.582097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:32.594401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ec9cf-fa6e-4bdf-8751-1d5f5ebc9826 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:32.652689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:32.653606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.653894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.654253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] PATH_INFO: `/v3/projects/905aecc2e33f4befb1a47740e8d53611` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:32.656569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] RBAC: Authorizing `identity:delete_project(project_id=905aecc2e33f4befb1a47740e8d53611)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:32.658543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:32.674381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:32.674381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:32.711115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905aecc2e33f4befb1a47740e8d53611', 'request_id': 'req-f32e6a6a-7894-46d7-8eb0-0d611f75037d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.721510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905aecc2e33f4befb1a47740e8d53611', 'request_id': 'req-f32e6a6a-7894-46d7-8eb0-0d611f75037d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.734654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905aecc2e33f4befb1a47740e8d53611', 'request_id': 'req-f32e6a6a-7894-46d7-8eb0-0d611f75037d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.751566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabf569-255d-49c8-8343-662b3cb4cde4 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:32.755674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] The token cache is being invalidate because project 905aecc2e33f4befb1a47740e8d53611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:32.756106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.758335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f32e6a6a-7894-46d7-8eb0-0d611f75037d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:32.759840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1073/2136] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:32 2022] DELETE /identity/v3/projects/905aecc2e33f4befb1a47740e8d53611 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:32.765504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544963-8fbe-4a8c-88e9-f9f5dd95776a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.765855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544963-8fbe-4a8c-88e9-f9f5dd95776a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.766069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544963-8fbe-4a8c-88e9-f9f5dd95776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:32.794630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:32.804203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b6544963-8fbe-4a8c-88e9-f9f5dd95776a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:32.805818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b6544963-8fbe-4a8c-88e9-f9f5dd95776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:32.828436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:32.829238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.829533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.829812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:32.833180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:32.883029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1074/2137] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:32.892385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.892930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.892930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:32.900679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:32.916879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:32.917536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:32.919125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:32.919273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:32.931089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1064/2138] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:32.932701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1075/2139] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:32.936776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:32.947762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a510-2053-4e5e-be29-85cf8eb89934 service glance] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:32.953272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:32.954029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.954332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.954646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:32.955447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:32.955757 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:32.957678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:32.972835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1065/2140] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:46:32.977466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:32.991640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70692f91-a42b-4566-8b10-5b324a0e56c2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:32.997305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:32.998052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:32.999002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:32.999387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.000278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.002221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.054797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1076/2141] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:32 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:33.059698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:33.087455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1792e8-1d6e-4793-bf51-b02eb3549dec admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:33.189897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:33.190972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.191522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.191978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.193149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.196534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.219511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1066/2142] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:33 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:33.223667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:33.234382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812533f8-50bb-4e91-85a7-ad0fe1097257 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:33.240668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:33.241412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.241737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.242139 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.242916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.244535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.255892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1077/2143] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:33.259995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:33.271021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553feb-f719-4bd5-869c-aa4f3aa6e229 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:33.276446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1b6f-adb9-45e0-9cff-b1e5588b1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:33.277145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1b6f-adb9-45e0-9cff-b1e5588b1b5c admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.277451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1b6f-adb9-45e0-9cff-b1e5588b1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.277749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1b6f-adb9-45e0-9cff-b1e5588b1b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.278443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b1b6f-adb9-45e0-9cff-b1e5588b1b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.280214 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b1b6f-adb9-45e0-9cff-b1e5588b1b5c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.291225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1067/2144] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:33.295206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:33.307158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ad2e8-9db2-408f-b518-42c93d2b5c45 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:33.313944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:33.316405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.316714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.317004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] PATH_INFO: `/v3/projects/e11e234f713b40cd8772372c2316dd28/users/d9c75043813844d79fd0764132dfe4dd/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.340226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11e234f713b40cd8772372c2316dd28, user_id=d9c75043813844d79fd0764132dfe4dd, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.347408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.366476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1078/2145] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:33 2022] PUT /identity/v3/projects/e11e234f713b40cd8772372c2316dd28/users/d9c75043813844d79fd0764132dfe4dd/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:33.372071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.372587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.373479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.397088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:33.398494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:33.491606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:33.507096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1068/2146] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:33.515895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:33.517677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:33.591420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf3b52-d20f-4acd-8f3e-6b32304116ce admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:33.595524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e7489-e754-4bd9-9eeb-0403550ed77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:33.596235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7489-e754-4bd9-9eeb-0403550ed77d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.596568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7489-e754-4bd9-9eeb-0403550ed77d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.596868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7489-e754-4bd9-9eeb-0403550ed77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.607374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e7489-e754-4bd9-9eeb-0403550ed77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.609436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e7489-e754-4bd9-9eeb-0403550ed77d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.619501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1079/2147] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:35.779048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:35.780705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:35.796196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a609-6c00-433e-958c-28287ac3f966 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:35.805199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:35.806343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:35.806805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:35.808051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] PATH_INFO: `/v3/users/caa89bf594b64422866601ffbd2ab956` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:35.810344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa89bf594b64422866601ffbd2ab956)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:35.813236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:35.915845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa89bf594b64422866601ffbd2ab956'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:35.916694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa89bf594b64422866601ffbd2ab956'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:35.925047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa89bf594b64422866601ffbd2ab956'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:35.925914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa89bf594b64422866601ffbd2ab956'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:35.938945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa89bf594b64422866601ffbd2ab956'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:35.970642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1069/2148] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:35 2022] DELETE /identity/v3/users/caa89bf594b64422866601ffbd2ab956 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:35.979801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:35.980283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:35.980446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:36.022305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:36.023783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:36.155485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1080/2149] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:36.167186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:36.168656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:36.250149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba8d4-2af3-4ea4-9ea9-31fd44b2a892 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:36.256215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:36.257127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:36.257491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:36.257848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:36.268672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:36.270302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:36.282078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1070/2150] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:36.725029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:36.726587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:36.751631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7d01-8aef-4672-9956-4e7bde73f510 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:36.757063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:36.758026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:36.758411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:36.758767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] PATH_INFO: `/v3/projects/78626c17863c4f28aa4f4f24ed14eb9d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:36.760289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78626c17863c4f28aa4f4f24ed14eb9d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:36.762466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:36.821650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:36.834297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78626c17863c4f28aa4f4f24ed14eb9d', 'request_id': 'req-30b1471e-e7bf-49fd-b959-f7536e40b7c1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.845814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78626c17863c4f28aa4f4f24ed14eb9d', 'request_id': 'req-30b1471e-e7bf-49fd-b959-f7536e40b7c1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.861183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78626c17863c4f28aa4f4f24ed14eb9d', 'request_id': 'req-30b1471e-e7bf-49fd-b959-f7536e40b7c1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.880762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] The token cache is being invalidate because project 78626c17863c4f28aa4f4f24ed14eb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:36.881598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.882289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.888263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1081/2151] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:36 2022] DELETE /identity/v3/projects/78626c17863c4f28aa4f4f24ed14eb9d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:36.889284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:36.908173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d69d-4f09-46e7-8cdb-4a33ad98dcc2 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:36.988785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:36.989685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:36.989975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:36.990257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] PATH_INFO: `/v3/users/a23c43cfca6b44c493976d1a06782f45` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:36.995296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23c43cfca6b44c493976d1a06782f45)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.000356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.021781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:37.087320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23c43cfca6b44c493976d1a06782f45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.088010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23c43cfca6b44c493976d1a06782f45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.101811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23c43cfca6b44c493976d1a06782f45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.102619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23c43cfca6b44c493976d1a06782f45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.118415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23c43cfca6b44c493976d1a06782f45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.166408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1071/2152] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:36 2022] DELETE /identity/v3/users/a23c43cfca6b44c493976d1a06782f45 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:37.802315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.804147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:37.827707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1471e-e7bf-49fd-b959-f7536e40b7c1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.928422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.929398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.929748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.930244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] PATH_INFO: `/v3/projects/81ef5e37dab845df8c4ea3f5abbaa936` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.931594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ef5e37dab845df8c4ea3f5abbaa936)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.937669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:38.008812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ef5e37dab845df8c4ea3f5abbaa936', 'request_id': 'req-98cdc379-7fa1-4788-bc39-c9871b7336ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.022731 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ef5e37dab845df8c4ea3f5abbaa936', 'request_id': 'req-98cdc379-7fa1-4788-bc39-c9871b7336ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.031232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ef5e37dab845df8c4ea3f5abbaa936', 'request_id': 'req-98cdc379-7fa1-4788-bc39-c9871b7336ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.053512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] The token cache is being invalidate because project 81ef5e37dab845df8c4ea3f5abbaa936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:38.054162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.055018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-98cdc379-7fa1-4788-bc39-c9871b7336ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.057080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1082/2153] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:37 2022] DELETE /identity/v3/projects/81ef5e37dab845df8c4ea3f5abbaa936 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:38.061212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:38.063429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:38.081723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415871-bb8f-40ab-9e70-4ec968f4bb20 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:38.183087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:38.183743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:38.184154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:38.184566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] PATH_INFO: `/v3/users/0947bcde7d2f443eb940d82facbdf710` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:38.185788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0947bcde7d2f443eb940d82facbdf710)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:38.188164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:38.292338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0947bcde7d2f443eb940d82facbdf710'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.293374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0947bcde7d2f443eb940d82facbdf710'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.300701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0947bcde7d2f443eb940d82facbdf710'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.301483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0947bcde7d2f443eb940d82facbdf710'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.317339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0947bcde7d2f443eb940d82facbdf710'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:38.349357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1072/2154] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:38 2022] DELETE /identity/v3/users/0947bcde7d2f443eb940d82facbdf710 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:38.517497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:38.517856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:38.518106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:38.569890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] MFA Rules not processed for user `d9c75043813844d79fd0764132dfe4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:38.571523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:38.634143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:38.661091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1083/2155] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:38.678555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:38.681264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:38.700919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:38.801735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a312a-dafd-4d0f-93d5-c9d07762ea10 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:38.807642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1ff08-1cdd-4d42-ba6e-7808cb6ca4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:38.808318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1ff08-1cdd-4d42-ba6e-7808cb6ca4ee service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:38.808821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1ff08-1cdd-4d42-ba6e-7808cb6ca4ee service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:38.809114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1ff08-1cdd-4d42-ba6e-7808cb6ca4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:38.820108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1ff08-1cdd-4d42-ba6e-7808cb6ca4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:38.821830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1ff08-1cdd-4d42-ba6e-7808cb6ca4ee service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:38.827846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:38.829304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:38.850490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1073/2156] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:38.921762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bae22-6636-4576-9265-33efa1fa4c40 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:38.927381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:38.930419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:38.931267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:38.933948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] PATH_INFO: `/v3/projects/db9800057820445b9ba82b88c19444e8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:38.935334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9800057820445b9ba82b88c19444e8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:38.938063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.002119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9800057820445b9ba82b88c19444e8', 'request_id': 'req-95b719ee-7fed-4793-9c8d-9b2025afc562'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:39.008395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9800057820445b9ba82b88c19444e8', 'request_id': 'req-95b719ee-7fed-4793-9c8d-9b2025afc562'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:39.016755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9800057820445b9ba82b88c19444e8', 'request_id': 'req-95b719ee-7fed-4793-9c8d-9b2025afc562'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:39.035065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] The token cache is being invalidate because project db9800057820445b9ba82b88c19444e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:39.035909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:39.036711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-95b719ee-7fed-4793-9c8d-9b2025afc562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:39.039064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1084/2157] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:38 2022] DELETE /identity/v3/projects/db9800057820445b9ba82b88c19444e8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:39.044382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.044738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.045086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.067091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:39.068318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:39.147369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1074/2158] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:39.156212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.156636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.156965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.185025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:39.185025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:39.198794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1085/2159] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:39.203481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.216472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b5363-10e8-4015-9e8c-9626177790f2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.223756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.224550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.224924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.225411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.226387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:39.226776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.228401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.246397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1075/2160] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:39.251213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.265098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1490eb-5c02-4178-a0db-f649552fcbf5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.271138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.271934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.272289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.272666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.273471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.275636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.307730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1086/2161] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:39 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:39.312697 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.324905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd574a9-0ff6-40f1-aabb-c9ac43806833 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.393388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.394626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.394626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.394904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.395766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.397774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.420745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1076/2162] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:39 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:39.424897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.438956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9628a8-ea51-4175-810c-ab94efe64a34 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.444369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.445048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.445340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.445622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.446373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.449752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.466054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1087/2163] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:39.470123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.480849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab7a1-0966-4744-95d5-173c36dd05c2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.489080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a84ff-5507-40e1-9597-93a4f640e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.491069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a84ff-5507-40e1-9597-93a4f640e942 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.491069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a84ff-5507-40e1-9597-93a4f640e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.491069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a84ff-5507-40e1-9597-93a4f640e942 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.492795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a84ff-5507-40e1-9597-93a4f640e942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.496078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a84ff-5507-40e1-9597-93a4f640e942 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.501675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:39.517866 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1077/2164] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:39.518687 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.529709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf45f2-b539-4086-9545-f964c53ef9a0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.534817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.536229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.536418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.536672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] PATH_INFO: `/v3/projects/97a828a8515e40bebf46450186a34a99/users/8974b0514a8a489192de23dda30b5865/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.556658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a828a8515e40bebf46450186a34a99, user_id=8974b0514a8a489192de23dda30b5865, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.559303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.578652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1088/2165] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:39 2022] PUT /identity/v3/projects/97a828a8515e40bebf46450186a34a99/users/8974b0514a8a489192de23dda30b5865/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:39.588875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f947-6599-4774-9ede-e0a4a0433dcf None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.589167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f947-6599-4774-9ede-e0a4a0433dcf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.589449 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f947-6599-4774-9ede-e0a4a0433dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.627486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-20d1f947-6599-4774-9ede-e0a4a0433dcf None None] MFA Rules not processed for user `8974b0514a8a489192de23dda30b5865`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:39.628771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-20d1f947-6599-4774-9ede-e0a4a0433dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:39.731448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1078/2166] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:39.767380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:39.771460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:39.791436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:39.847920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1638-87a4-42c3-b5d2-73882be6fce4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:39.851984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:39.852755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:39.853038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:39.853434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:39.868663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:39.870167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:39.881657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1089/2167] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:40.563171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110730ab-9faa-4497-9caf-2767e45c37ad None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:40.563726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110730ab-9faa-4497-9caf-2767e45c37ad None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:40.563881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110730ab-9faa-4497-9caf-2767e45c37ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:40.585616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-110730ab-9faa-4497-9caf-2767e45c37ad None None] MFA Rules not processed for user `d9c75043813844d79fd0764132dfe4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:40.586876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-110730ab-9faa-4497-9caf-2767e45c37ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:40.650970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1079/2168] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:47.080350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:47.081814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:47.149891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fc877-68bb-4f7a-8696-8abf394e7edb service glance] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:47.154467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:47.155490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:47.155780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:47.156061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] PATH_INFO: `/v3/users/13cdabdaf85842f1a20b2aab062255d1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:47.157263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cdabdaf85842f1a20b2aab062255d1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:47.159234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:47.208505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cdabdaf85842f1a20b2aab062255d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.223925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cdabdaf85842f1a20b2aab062255d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.225059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cdabdaf85842f1a20b2aab062255d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.225678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cdabdaf85842f1a20b2aab062255d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.233724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cdabdaf85842f1a20b2aab062255d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.246857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1090/2169] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:47 2022] DELETE /identity/v3/users/13cdabdaf85842f1a20b2aab062255d1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:47.251656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:47.252156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:47.252242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:47.269964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:47.271291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:47.344371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1080/2170] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:47.356182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:47.357943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:47.406842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:47.430702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de291-e0f5-47a5-a521-1c126750b7a7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:47.434833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e0e9-e621-4cf5-b172-52d4b7169e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:47.435482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e0e9-e621-4cf5-b172-52d4b7169e5c service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:47.436296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e0e9-e621-4cf5-b172-52d4b7169e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:47.436609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e0e9-e621-4cf5-b172-52d4b7169e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:47.453382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584e0e9-e621-4cf5-b172-52d4b7169e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:47.454436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584e0e9-e621-4cf5-b172-52d4b7169e5c service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:47.474163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1091/2171] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:47.864549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:47.866046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:47.878991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667012-40ca-4d7e-8c73-00e57a332a3d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:47.903044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:47.911419 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:47.912015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:47.912452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] PATH_INFO: `/v3/projects/56d7092eca6f495fbb19ed5c37bb4b93` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:47.913963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d7092eca6f495fbb19ed5c37bb4b93)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:47.916017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:47.951982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:47.971780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d7092eca6f495fbb19ed5c37bb4b93', 'request_id': 'req-dc541e43-afb9-4b0f-ba33-4aae169e698e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.979312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d7092eca6f495fbb19ed5c37bb4b93', 'request_id': 'req-dc541e43-afb9-4b0f-ba33-4aae169e698e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.985733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d7092eca6f495fbb19ed5c37bb4b93', 'request_id': 'req-dc541e43-afb9-4b0f-ba33-4aae169e698e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.995875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] The token cache is being invalidate because project 56d7092eca6f495fbb19ed5c37bb4b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:47.996169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.996803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-dc541e43-afb9-4b0f-ba33-4aae169e698e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:47.998964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1081/2172] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:47 2022] DELETE /identity/v3/projects/56d7092eca6f495fbb19ed5c37bb4b93 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:48.003948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.004241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.004528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.023102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:48.024306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:48.088835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1092/2173] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:48.096784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.097077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.097356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.115947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:48.117155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:48.126005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1082/2174] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:48.130339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.140984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f7c76-eb04-4845-91ed-f7a00620d309 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.145589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.146273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.146600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.146887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.147625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:48.147940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.149563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.162042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1093/2175] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:48.166202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.177896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58078f6-5604-49bf-a917-e090a95ded8e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.185240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.186779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.187204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.187603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.191145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.191145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.219981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1083/2176] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:48 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:48.224156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.234579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bbbb-0265-4a5b-964d-db27a3dcf197 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.291573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.292250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.292536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.292816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.293505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.295489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.316875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1094/2177] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:48 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:48.321024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.331524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce68ea-1023-4576-9b83-8ed51cc946d2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.336182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.336838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.337848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.338134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.339564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.341160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.352440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1084/2178] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:48.357117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.368057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444359f9-66e0-4b83-9218-a696e3a00b3a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.374046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cef23-3825-4561-8a74-ba7bdae5351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.374947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cef23-3825-4561-8a74-ba7bdae5351e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.375259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cef23-3825-4561-8a74-ba7bdae5351e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.375560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cef23-3825-4561-8a74-ba7bdae5351e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.376289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cef23-3825-4561-8a74-ba7bdae5351e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.378059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cef23-3825-4561-8a74-ba7bdae5351e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.389448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1095/2179] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:48.393709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.403696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e072c0-f887-4681-9eac-0b0e79a616c7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.412188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.413006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.413292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.413561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] PATH_INFO: `/v3/projects/537dfdfbaae043f38cd4300e1b030682/users/fdc32c284f7e498e9d53402e73e76c88/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.433216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537dfdfbaae043f38cd4300e1b030682, user_id=fdc32c284f7e498e9d53402e73e76c88, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.436524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.455137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1085/2180] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:48 2022] PUT /identity/v3/projects/537dfdfbaae043f38cd4300e1b030682/users/fdc32c284f7e498e9d53402e73e76c88/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:48.469033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.469599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.470008 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.509043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] MFA Rules not processed for user `fdc32c284f7e498e9d53402e73e76c88`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:48.510439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:48.545510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:48.580206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1096/2181] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:48.590877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:48.593203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:48.666144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa99d-aaf1-4d77-8183-85e8b76cae42 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:48.669964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf30846-a52e-4189-978f-18ee19a876e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:48.671321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30846-a52e-4189-978f-18ee19a876e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:48.671706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30846-a52e-4189-978f-18ee19a876e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:48.672020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30846-a52e-4189-978f-18ee19a876e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:48.692173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf30846-a52e-4189-978f-18ee19a876e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:48.693687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf30846-a52e-4189-978f-18ee19a876e4 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:48.704809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1086/2182] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:49.756622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:49.758051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:49.823140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603214a-0d8b-451a-b0ab-e9f458df5311 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:49.828288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:49.829149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:49.829432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:49.829710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] PATH_INFO: `/v3/users/f6536ace8edc480c87bed9d11989bfd4` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:49.830927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6536ace8edc480c87bed9d11989bfd4)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:49.832839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:49.884571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6536ace8edc480c87bed9d11989bfd4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:49.897859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6536ace8edc480c87bed9d11989bfd4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:49.898605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6536ace8edc480c87bed9d11989bfd4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:49.899225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6536ace8edc480c87bed9d11989bfd4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:49.907038 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6536ace8edc480c87bed9d11989bfd4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:49.920874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1097/2183] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:49 2022] DELETE /identity/v3/users/f6536ace8edc480c87bed9d11989bfd4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:49.925768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263632-35b4-41a1-ae49-8977fc226f23 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:49.926304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263632-35b4-41a1-ae49-8977fc226f23 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:49.926468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263632-35b4-41a1-ae49-8977fc226f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:49.946867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6b263632-35b4-41a1-ae49-8977fc226f23 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:49.948607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6b263632-35b4-41a1-ae49-8977fc226f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:50.008033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:50.022807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1087/2184] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:50.033295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.034870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:50.102087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f5893-bc9c-4038-8b86-41d8b815824a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.103387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939204a-6781-4cc7-af7a-24ce9f115450 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.103687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939204a-6781-4cc7-af7a-24ce9f115450 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.103970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939204a-6781-4cc7-af7a-24ce9f115450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.106532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.107174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.107462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.108274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.116356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:50.125078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.127128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.129474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d939204a-6781-4cc7-af7a-24ce9f115450 None None] MFA Rules not processed for user `fdc32c284f7e498e9d53402e73e76c88`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:50.130739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d939204a-6781-4cc7-af7a-24ce9f115450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:50.137982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1098/2185] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:50.192173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1088/2186] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:50.414715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.416748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:50.433847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e0c01-ac75-4f1b-82e5-f99e6995ed8d service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.439739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.440610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.440893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.441158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] PATH_INFO: `/v3/projects/63b2c17379234dc58538d21b0eb1ebf8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.443090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b2c17379234dc58538d21b0eb1ebf8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.445363 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.502021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b2c17379234dc58538d21b0eb1ebf8', 'request_id': 'req-96a6148f-c374-45c3-b227-c0ce8294e27f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:50.507484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b2c17379234dc58538d21b0eb1ebf8', 'request_id': 'req-96a6148f-c374-45c3-b227-c0ce8294e27f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:50.513512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b2c17379234dc58538d21b0eb1ebf8', 'request_id': 'req-96a6148f-c374-45c3-b227-c0ce8294e27f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:50.525885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] The token cache is being invalidate because project 63b2c17379234dc58538d21b0eb1ebf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:50.526175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:50.526840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-96a6148f-c374-45c3-b227-c0ce8294e27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:50.528375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1099/2187] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:50 2022] DELETE /identity/v3/projects/63b2c17379234dc58538d21b0eb1ebf8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:50.533779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.534016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.534299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.559998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:50.561205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:50.618687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1089/2188] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:50.627040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.627334 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.627617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.645595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:50.646821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:50.654702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1100/2189] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:50.658790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.668610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e46f33-87ab-484d-b6d6-2af6c512d9fe None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.675489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.676482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.677143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.677607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.678724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:50.679370 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.681495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.697263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1090/2190] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:50.701938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.711483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28510f-a5c1-4e47-80a1-075fb54c05b5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.716172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.716821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.717157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.717441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.718135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.720088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.745507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1101/2191] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:50 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:50.749793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.760252 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceaae1-c657-4e25-8b90-3d1190aeab7b admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.825872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.827124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.827664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.827966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.828670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.830614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.860384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1091/2192] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:50 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:50.861841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.872599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65877-160c-4334-a1ab-144493b85e18 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.877755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.878543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.878821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.879099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.879832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.881490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.893276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1102/2193] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:50.897254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.907691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679e96-dea5-4c0b-b6a3-8bfbdba274d2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.913015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c8931-bd11-4f62-af6f-5fcaa7c5e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.913718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8931-bd11-4f62-af6f-5fcaa7c5e110 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.914076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8931-bd11-4f62-af6f-5fcaa7c5e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.914462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8931-bd11-4f62-af6f-5fcaa7c5e110 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.915330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c8931-bd11-4f62-af6f-5fcaa7c5e110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.917151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c8931-bd11-4f62-af6f-5fcaa7c5e110 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.928338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1092/2194] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:46:50.932266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:50.942814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1f84-9b1c-41df-8004-a502e0935575 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:50.947394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:50.948754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.949040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.949316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] PATH_INFO: `/v3/projects/73016572dfb849ff858c1da50cfb2714/users/3da076f677bc478ca3feb304f3243dab/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:50.964578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73016572dfb849ff858c1da50cfb2714, user_id=3da076f677bc478ca3feb304f3243dab, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:50.968581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:50.986155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1103/2195] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:50 2022] PUT /identity/v3/projects/73016572dfb849ff858c1da50cfb2714/users/3da076f677bc478ca3feb304f3243dab/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:50.996532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:50.996843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:50.997149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:51.011086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:51.031658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] MFA Rules not processed for user `3da076f677bc478ca3feb304f3243dab`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:51.032976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:51.098463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1093/2196] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:51.109982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:51.111928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:51.174288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dff48-a8b8-4852-b99c-f5861f4fec50 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:51.177992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f41a-2f3b-4953-a690-35c1e76cdc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:51.178675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f41a-2f3b-4953-a690-35c1e76cdc62 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:51.178961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f41a-2f3b-4953-a690-35c1e76cdc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:51.179241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f41a-2f3b-4953-a690-35c1e76cdc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:51.188608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95f41a-2f3b-4953-a690-35c1e76cdc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:51.190062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95f41a-2f3b-4953-a690-35c1e76cdc62 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:51.199278 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1104/2197] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:01.095423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=29 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:01.195146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:15.915067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:15.979266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3b525-9443-4f43-9f96-8ebc385efde8 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:15.983750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:15.984611 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:15.984894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:15.985164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] PATH_INFO: `/v3/users/3da076f677bc478ca3feb304f3243dab` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:15.986929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da076f677bc478ca3feb304f3243dab)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:15.988854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:16.035711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da076f677bc478ca3feb304f3243dab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.036631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da076f677bc478ca3feb304f3243dab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.043537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da076f677bc478ca3feb304f3243dab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.044207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da076f677bc478ca3feb304f3243dab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.054181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da076f677bc478ca3feb304f3243dab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.078595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1094/2198] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:15 2022] DELETE /identity/v3/users/3da076f677bc478ca3feb304f3243dab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:16.083871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.083871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.084368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.101804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:16.103083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:16.170242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1105/2199] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:16.180594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:16.182042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:16.249539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b55b5b-9781-44de-b344-16cdc51812e2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:16.253543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc810dc-520f-437c-94a3-698d7026edca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:16.254198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc810dc-520f-437c-94a3-698d7026edca service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.254519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc810dc-520f-437c-94a3-698d7026edca service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.254809 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc810dc-520f-437c-94a3-698d7026edca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.264723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc810dc-520f-437c-94a3-698d7026edca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:16.266304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc810dc-520f-437c-94a3-698d7026edca service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:16.277918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1095/2200] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:16.636666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:16.638162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:16.652093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd150-3474-43a9-bf3c-15ce449c7b04 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:16.656985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:16.658711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.659093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.659476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] PATH_INFO: `/v3/projects/73016572dfb849ff858c1da50cfb2714` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.660806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=73016572dfb849ff858c1da50cfb2714)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:16.663425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:16.726797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73016572dfb849ff858c1da50cfb2714', 'request_id': 'req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.732513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73016572dfb849ff858c1da50cfb2714', 'request_id': 'req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.743215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73016572dfb849ff858c1da50cfb2714', 'request_id': 'req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.756527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] The token cache is being invalidate because project 73016572dfb849ff858c1da50cfb2714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:16.756829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.757474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8ca53906-f3e7-4a5c-ae9e-ce3cdcd462ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:16.759371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1106/2201] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:16 2022] DELETE /identity/v3/projects/73016572dfb849ff858c1da50cfb2714 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:16.764069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.764431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.764780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.784765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:16.786606 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:16.813554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:16.856425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1096/2202] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:16.866294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.866623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.866913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.887641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:16.888870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:16.900739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1107/2203] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:16.905242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:16.917731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d03ea-bb9a-41e3-8280-75053ce7565b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:16.926205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:16.926917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.927203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.927481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.928711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:16.929026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:16.930826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:16.948604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1097/2204] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:47:16.952893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:16.966944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fd391-26be-4a80-8f57-756459e7146e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:16.967721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:16.968370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:16.968653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:16.968929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:16.969622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:16.971631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:16.998678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1108/2205] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:16 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:17.003337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:17.013969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a1ad-0b74-4bab-a6ce-275a89fdb1ac admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:17.072641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:17.073430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.073788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.074137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.074933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:17.076914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:17.101394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1098/2206] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:17 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:17.105432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:17.116661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b500a-3a1a-43b6-aa96-439d5e09094b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:17.121523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:17.122261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.122645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.123005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.123812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:17.125478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:17.140228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1109/2207] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:17.141394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:17.151422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c748b3-7202-4111-9860-4e5b448eef57 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:17.156182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeab29-469e-48e1-98f6-2e0854cec9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:17.156849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab29-469e-48e1-98f6-2e0854cec9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.157136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab29-469e-48e1-98f6-2e0854cec9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.157416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab29-469e-48e1-98f6-2e0854cec9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.158892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfeab29-469e-48e1-98f6-2e0854cec9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:17.160496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfeab29-469e-48e1-98f6-2e0854cec9d1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:17.170813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1099/2208] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:17.174968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:17.185133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57f0c-b238-4364-80cf-56e12452940f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:17.190610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:17.191501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.191806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.192066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] PATH_INFO: `/v3/projects/6827afcdf1f3481882f808dc01908a4d/users/ae334c4d93cd4d3e94789a5985fcfa77/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.215900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6827afcdf1f3481882f808dc01908a4d, user_id=ae334c4d93cd4d3e94789a5985fcfa77, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:17.218696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:17.233062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1110/2209] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:17 2022] PUT /identity/v3/projects/6827afcdf1f3481882f808dc01908a4d/users/ae334c4d93cd4d3e94789a5985fcfa77/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:17.238875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad44c8-c9ef-4721-83b0-c7b5e12da45c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.239171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad44c8-c9ef-4721-83b0-c7b5e12da45c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.239458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad44c8-c9ef-4721-83b0-c7b5e12da45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.258496 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e5ad44c8-c9ef-4721-83b0-c7b5e12da45c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:17.259728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e5ad44c8-c9ef-4721-83b0-c7b5e12da45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:17.319620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1100/2210] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:17.329494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:17.331465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:17.353750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:17.391310 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb9dcd-a80b-4199-9241-25e2e886fa27 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:17.394976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:17.395619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.395910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.396194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.405240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:17.406713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:17.416893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1111/2211] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:22.366738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.367227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.367315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.394712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] MFA Rules not processed for user `ae334c4d93cd4d3e94789a5985fcfa77`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:22.396026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:22.414213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:22.471479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1101/2212] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:22.476577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.490862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b0bb-d0be-4b92-b9e5-ed7c383916d8 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.496302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.496966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.497250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.497693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.498463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.502508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.534712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1112/2213] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:22 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:22.538773 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.551303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5560c4-1992-4051-b60d-1e89a9e0a612 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.615522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.616201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.616492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.616776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.617490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.619498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.644605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1102/2214] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:22 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:22.646023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.660229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecd37d-1672-4d25-a742-034206f763c6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.665321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.666000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.666287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.666604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.667356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.668984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.682948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1113/2215] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:22.687058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.698107 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3a0b9-5ab5-4c76-8009-e109262da6ea admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.703150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.704045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.704364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.704826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] PATH_INFO: `/v3/projects/bc5b6a62a8384289937a094bac0d6d17/users/de5ac74177c9406aae98af215872c997/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.721184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5b6a62a8384289937a094bac0d6d17, user_id=de5ac74177c9406aae98af215872c997, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.723823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.739738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1103/2216] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:22 2022] PUT /identity/v3/projects/bc5b6a62a8384289937a094bac0d6d17/users/de5ac74177c9406aae98af215872c997/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:22.743955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.756018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2ae7c-e0b4-447b-bbd4-227be7be271e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.864218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.865031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.865361 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.867555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.868590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.872158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.891602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1114/2217] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:22.893778 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.912483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb5f1-dbf3-4577-8e6a-1c309af6cffd admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.922905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec07e1-830e-458e-a2c9-fd7149902c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.923968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec07e1-830e-458e-a2c9-fd7149902c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.924488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec07e1-830e-458e-a2c9-fd7149902c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.924737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec07e1-830e-458e-a2c9-fd7149902c0c admin admin] PATH_INFO: `/v3/projects/bc5b6a62a8384289937a094bac0d6d17/users/de5ac74177c9406aae98af215872c997/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.927257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec07e1-830e-458e-a2c9-fd7149902c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5b6a62a8384289937a094bac0d6d17, user_id=de5ac74177c9406aae98af215872c997, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.930001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec07e1-830e-458e-a2c9-fd7149902c0c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.953111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1104/2218] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:22 2022] PUT /identity/v3/projects/bc5b6a62a8384289937a094bac0d6d17/users/de5ac74177c9406aae98af215872c997/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:26.420104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:26.422076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:26.462848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a6da2-eb35-44f1-b978-316fae026d5a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:26.575133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:26.576663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:26.576957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:26.577241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] PATH_INFO: `/v3/users/8974b0514a8a489192de23dda30b5865` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:26.581749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8974b0514a8a489192de23dda30b5865)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:26.586398 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:26.655088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:26.712595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8974b0514a8a489192de23dda30b5865'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:26.733841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8974b0514a8a489192de23dda30b5865'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:26.735047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8974b0514a8a489192de23dda30b5865'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:26.736612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8974b0514a8a489192de23dda30b5865'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:26.754295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8974b0514a8a489192de23dda30b5865'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:26.801142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1115/2219] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:26 2022] DELETE /identity/v3/users/8974b0514a8a489192de23dda30b5865 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:26.805823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:26.806339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:26.806339 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:26.839581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:26.841331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:27.034152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1105/2220] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:27.047587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:27.050475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:27.147705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bc113-9e0b-45a2-a2d7-a2a2bba6fdc2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:27.154866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26343-6334-453f-94fa-59e0d56ad4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:27.155539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26343-6334-453f-94fa-59e0d56ad4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:27.155830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26343-6334-453f-94fa-59e0d56ad4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:27.156116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26343-6334-453f-94fa-59e0d56ad4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:27.184279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26343-6334-453f-94fa-59e0d56ad4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:27.185635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26343-6334-453f-94fa-59e0d56ad4c3 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:27.207478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1116/2221] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:27.854969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:27.859536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:27.884208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a250-3bf8-4f75-a06a-50d36e3fccf6 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:27.899240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:27.900329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:27.900852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:27.901278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] PATH_INFO: `/v3/projects/97a828a8515e40bebf46450186a34a99` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:27.902744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a828a8515e40bebf46450186a34a99)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:27.904825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:27.927912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:27.979114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a828a8515e40bebf46450186a34a99', 'request_id': 'req-434bbacd-89d3-4428-baf7-4397d1b8fbd3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:27.993275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a828a8515e40bebf46450186a34a99', 'request_id': 'req-434bbacd-89d3-4428-baf7-4397d1b8fbd3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.011358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a828a8515e40bebf46450186a34a99', 'request_id': 'req-434bbacd-89d3-4428-baf7-4397d1b8fbd3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.046043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] The token cache is being invalidate because project 97a828a8515e40bebf46450186a34a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:28.046296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.047366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-434bbacd-89d3-4428-baf7-4397d1b8fbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.054821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1106/2222] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:27 2022] DELETE /identity/v3/projects/97a828a8515e40bebf46450186a34a99 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:28.059437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.059939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.060034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.087624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:28.089786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.172123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1117/2223] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:28.180916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.181217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.181506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.207099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:28.208420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.223276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1107/2224] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:28.228064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.245320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969125-d4ec-447a-8efc-ce9082ac0b37 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.253158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.254087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.255522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.255992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.258469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:28.259589 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.261611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.278069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1118/2225] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:28.282010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.294744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb0fc8-61e1-425a-a2a6-2005150bb0da None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.303810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.304848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.305165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.305455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.306167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.308143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.341802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1108/2226] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:28.346224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.362814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348c224-0a1e-48c7-980a-5333d75fc773 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.440455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:28.514520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.515765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.515765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.515765 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.516449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.519866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.576271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1119/2227] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:28.579448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.596935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eaab2-fa7a-4202-995e-e17dbca08e71 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.608289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.609105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.610351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.611665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.612815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.616559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.617705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.619686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.632638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1109/2228] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:28.635448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.639776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097718-2f9a-4e20-8658-4750cd46f503 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.654788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.655978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.656421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.656851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] PATH_INFO: `/v3/users/23ab113e16824c88b040c6ab74ff205b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.659106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ab113e16824c88b040c6ab74ff205b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.663475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca896b-0e4c-4e6c-8018-80f6812697cc admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.663803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.688223 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.693009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.694236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.696373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.697759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.702616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.746657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1110/2229] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:28.747969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.765392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee33e0b-11ea-449c-95c9-1b096490a1d6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.774080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ada435-f56a-42a2-a76b-6896a031b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.775310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ada435-f56a-42a2-a76b-6896a031b012 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.775689 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ada435-f56a-42a2-a76b-6896a031b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.776161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ada435-f56a-42a2-a76b-6896a031b012 admin admin] PATH_INFO: `/v3/projects/41bf5203b925421b9dd2ccc5b7d40ad8/users/86bf2b338eac47f6bcf20a48770b2e01/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.787176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ab113e16824c88b040c6ab74ff205b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.796509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ada435-f56a-42a2-a76b-6896a031b012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bf5203b925421b9dd2ccc5b7d40ad8, user_id=86bf2b338eac47f6bcf20a48770b2e01, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.801003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ada435-f56a-42a2-a76b-6896a031b012 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.810851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ab113e16824c88b040c6ab74ff205b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.812316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ab113e16824c88b040c6ab74ff205b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.813185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ab113e16824c88b040c6ab74ff205b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.822317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1111/2230] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:28 2022] PUT /identity/v3/projects/41bf5203b925421b9dd2ccc5b7d40ad8/users/86bf2b338eac47f6bcf20a48770b2e01/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:28.826550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-30b819e3-0e04-40d4-a55c-cb8bbd6ea9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ab113e16824c88b040c6ab74ff205b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.828744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.829151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.830575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.852891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1120/2231] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:28 2022] DELETE /identity/v3/users/23ab113e16824c88b040c6ab74ff205b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:28.857249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.858278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:28.858949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.859101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.861448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.891235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:28.893550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.013263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1112/2232] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:29.047078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:29.049812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.071976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1121/2233] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:29.076780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:29.080512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.089935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:29.181202 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4d433-cd47-4dc2-8470-4e12b0f6eaf2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.187187 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:29.195670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779b0e9-c797-4dca-9b78-328d102f64d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.197784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779b0e9-c797-4dca-9b78-328d102f64d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.198069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779b0e9-c797-4dca-9b78-328d102f64d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.199478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779b0e9-c797-4dca-9b78-328d102f64d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.224170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c377437-a4e2-4a46-af58-285a5334693c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.224387 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779b0e9-c797-4dca-9b78-328d102f64d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.226632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779b0e9-c797-4dca-9b78-328d102f64d1 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:29.230712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.232101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.232553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.232927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.244140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.245610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:29.247682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1113/2234] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:29.258042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1122/2235] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:29.912097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:29.912445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c633-8a75-40a4-8978-1613f86c9180 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.912888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c633-8a75-40a4-8978-1613f86c9180 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.913001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c633-8a75-40a4-8978-1613f86c9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.914912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.933464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e19ad-129b-4302-bff7-002adcd9f01c service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.940380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.941527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.942010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.942443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] PATH_INFO: `/v3/projects/3864c04174af4b648382ba263b4f7fd8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.948583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3864c04174af4b648382ba263b4f7fd8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.950823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:29.971605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7284c633-8a75-40a4-8978-1613f86c9180 None None] MFA Rules not processed for user `de5ac74177c9406aae98af215872c997`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:29.973075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7284c633-8a75-40a4-8978-1613f86c9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.023397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3864c04174af4b648382ba263b4f7fd8', 'request_id': 'req-8aea1a15-b558-43c2-9b29-2cdf04e718dc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.035680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3864c04174af4b648382ba263b4f7fd8', 'request_id': 'req-8aea1a15-b558-43c2-9b29-2cdf04e718dc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.047498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3864c04174af4b648382ba263b4f7fd8', 'request_id': 'req-8aea1a15-b558-43c2-9b29-2cdf04e718dc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.067221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] The token cache is being invalidate because project 3864c04174af4b648382ba263b4f7fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:30.067521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.068470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.070071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1123/2236] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:29 2022] DELETE /identity/v3/projects/3864c04174af4b648382ba263b4f7fd8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:30.230249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1114/2237] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:30.415793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.417899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.497829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.498127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.498582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.547725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] MFA Rules not processed for user `86bf2b338eac47f6bcf20a48770b2e01`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:30.550277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.553558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1a15-b558-43c2-9b29-2cdf04e718dc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.560379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.561088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.561377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.561654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.563578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.694108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1115/2238] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:30.698399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.700290 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d86c2-d7b9-4024-a84e-a5e5760754c0 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.706027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:30.715012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.716428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.717911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1124/2239] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:30.773164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:30.797033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80151032-a0a4-4858-b574-f5e99df3ba29 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.802381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7be5b-f25d-404b-8b1e-d5e6a65f74ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.803235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7be5b-f25d-404b-8b1e-d5e6a65f74ec service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.803603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7be5b-f25d-404b-8b1e-d5e6a65f74ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.803963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7be5b-f25d-404b-8b1e-d5e6a65f74ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.816572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7be5b-f25d-404b-8b1e-d5e6a65f74ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.818194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7be5b-f25d-404b-8b1e-d5e6a65f74ec service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.862747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1116/2240] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:32.678144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:32.678761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:32.678859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:32.715196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] MFA Rules not processed for user `86bf2b338eac47f6bcf20a48770b2e01`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:32.716462 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:32.725149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1125/2241] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:33.638141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50597-e935-44bf-8bf5-b44be0d65c98 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:33.638627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50597-e935-44bf-8bf5-b44be0d65c98 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:33.638875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50597-e935-44bf-8bf5-b44be0d65c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:33.660570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a4a50597-e935-44bf-8bf5-b44be0d65c98 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:33.662253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a4a50597-e935-44bf-8bf5-b44be0d65c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:33.792949 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1117/2242] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:33.866760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:33.868968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:33.999836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25977e3a-5c1e-4443-80c3-dddb1fb82573 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:34.010757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c39ed0-0546-40e8-acf1-fef888cd0312 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:34.012090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c39ed0-0546-40e8-acf1-fef888cd0312 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:34.012789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c39ed0-0546-40e8-acf1-fef888cd0312 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:34.013545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c39ed0-0546-40e8-acf1-fef888cd0312 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:34.043299 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c39ed0-0546-40e8-acf1-fef888cd0312 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:34.045393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c39ed0-0546-40e8-acf1-fef888cd0312 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:34.080132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1126/2243] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:47:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:47:34.494812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:34.496142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:34.496586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:34.522103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] MFA Rules not processed for user `2d7c42cf0bc84292bb0b7edb9f2e7fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:34.524010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:34.663636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1118/2244] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:43.874518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070ed4-a9fe-4e4b-b2ec-712b275a24fc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.875405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070ed4-a9fe-4e4b-b2ec-712b275a24fc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.875405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070ed4-a9fe-4e4b-b2ec-712b275a24fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.900103 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e2070ed4-a9fe-4e4b-b2ec-712b275a24fc None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:43.902546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e2070ed4-a9fe-4e4b-b2ec-712b275a24fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:43.910796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1127/2245] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:43.937150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:43.951206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26b2e-0436-4f78-83da-df1effa30ed4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:43.975163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.976235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.976533 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.976917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:44.009421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:44.011336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:44.046336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1119/2246] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:47:45.138252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978688a-bf6b-4158-bd28-2dc48f824a43 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.138796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978688a-bf6b-4158-bd28-2dc48f824a43 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.138914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978688a-bf6b-4158-bd28-2dc48f824a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.214993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e978688a-bf6b-4158-bd28-2dc48f824a43 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:45.216511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e978688a-bf6b-4158-bd28-2dc48f824a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:45.239851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1128/2247] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 19 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:45.306257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:45.325028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc0d7-5f18-4d25-9eff-e5d95b5f42c5 service swift] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:45.331418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:45.332080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.332368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.332645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.345725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:45.347783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:45.358026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1120/2248] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:47:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:47:45.856198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6582ed4-4f5f-4db8-811d-0f40ab5e55b2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.856801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6582ed4-4f5f-4db8-811d-0f40ab5e55b2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.857258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6582ed4-4f5f-4db8-811d-0f40ab5e55b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.913090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c6582ed4-4f5f-4db8-811d-0f40ab5e55b2 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:45.916280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c6582ed4-4f5f-4db8-811d-0f40ab5e55b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:45.940026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1129/2249] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:45.941037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:45.955087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b128c-4111-468c-a2de-71439a596ec9 service swift] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:45.967580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23691e-1218-4e4e-91b1-f41b0ae65974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:45.968586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23691e-1218-4e4e-91b1-f41b0ae65974 service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.969180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23691e-1218-4e4e-91b1-f41b0ae65974 service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.969468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23691e-1218-4e4e-91b1-f41b0ae65974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.980529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23691e-1218-4e4e-91b1-f41b0ae65974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:45.982910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23691e-1218-4e4e-91b1-f41b0ae65974 service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:45.996660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1121/2250] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:47:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:47:46.744677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.745691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.746329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.775377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:46.777143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.788544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1130/2251] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:46.898671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845043-5847-42cc-bfde-a6b4364ab34a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.899229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845043-5847-42cc-bfde-a6b4364ab34a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.899229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845043-5847-42cc-bfde-a6b4364ab34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.952625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-12845043-5847-42cc-bfde-a6b4364ab34a None None] MFA Rules not processed for user `4785719411fd4af892868d99fca7cd71`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:46.953859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-12845043-5847-42cc-bfde-a6b4364ab34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.963521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.995570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd3bc3-a236-4217-aa47-e55154d58a8d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.024506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.031276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.032031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.033174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.064150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.064655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:47.068037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.086204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1131/2252] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:47:47.097714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1122/2253] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:49.544958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:49.548181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:49.662781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730b3fd-bad8-40bc-af1d-ac0d0857b181 service swift] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:49.667951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:49.668919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:49.669208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:49.669874 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] PATH_INFO: `/v3/users/fdc32c284f7e498e9d53402e73e76c88` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:49.670803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc32c284f7e498e9d53402e73e76c88)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:49.673656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:49.731258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:49.733075 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc32c284f7e498e9d53402e73e76c88'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:49.748307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc32c284f7e498e9d53402e73e76c88'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:49.749030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc32c284f7e498e9d53402e73e76c88'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:49.749643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc32c284f7e498e9d53402e73e76c88'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:49.760369 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc32c284f7e498e9d53402e73e76c88'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:49.784076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1132/2254] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:49 2022] DELETE /identity/v3/users/fdc32c284f7e498e9d53402e73e76c88 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:49.789161 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:49.789718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:49.789718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:49.807627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:49.808859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:49.869974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1123/2255] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:49.879648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:49.881087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:49.937049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9f7e-5281-4d01-ad09-0c122f2a9f92 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:49.940760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1b07-cb5d-4323-9454-dd0d6db2ee46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:49.941327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1b07-cb5d-4323-9454-dd0d6db2ee46 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:49.941610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1b07-cb5d-4323-9454-dd0d6db2ee46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:49.941886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1b07-cb5d-4323-9454-dd0d6db2ee46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:49.952343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d1b07-cb5d-4323-9454-dd0d6db2ee46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:49.953755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d1b07-cb5d-4323-9454-dd0d6db2ee46 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:49.963707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1133/2256] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:50.137190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.138760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:50.150769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b1db2-a42f-496a-91bf-9a9a030d0e34 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.155670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.156537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.156817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.157619 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] PATH_INFO: `/v3/projects/537dfdfbaae043f38cd4300e1b030682` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.158872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] RBAC: Authorizing `identity:delete_project(project_id=537dfdfbaae043f38cd4300e1b030682)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.160820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.217948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537dfdfbaae043f38cd4300e1b030682', 'request_id': 'req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:50.226176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537dfdfbaae043f38cd4300e1b030682', 'request_id': 'req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:50.232586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537dfdfbaae043f38cd4300e1b030682', 'request_id': 'req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:50.243512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] The token cache is being invalidate because project 537dfdfbaae043f38cd4300e1b030682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:50.243819 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:50.244425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4e1c9f05-ec6a-46ba-9617-be5a7efc659a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:50.245956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1124/2257] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:50 2022] DELETE /identity/v3/projects/537dfdfbaae043f38cd4300e1b030682 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:50.251206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.251629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.251920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.271897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:50.273114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:50.332566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1134/2258] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:50.340326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.340618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.340901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.359547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:50.361488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:50.369501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1125/2259] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:50.373814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.384384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576fa1-16cf-4ebc-8d2d-d430cf4e7cb2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.388968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.389619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.389905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.390186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.390948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:50.391262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.393541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.404824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1135/2260] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:50.409046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.418468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839c67-b726-49c9-bea4-08b3f0387857 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.423171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.423818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.424100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.424378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.425066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.427017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.459501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1126/2261] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:50 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:50.461540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.472741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c50aef-cf58-449c-84f4-56736f2bba0c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.524194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:50.537403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.538080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.538386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.538680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.539376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.541300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.564806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1136/2262] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:50 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:50.566068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.576312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec3cb-9729-47bd-a992-d2c2f6d512a0 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.581104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.581765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.582053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.582338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.583190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.584791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.595254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1127/2263] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:50.599281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.609364 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ace13-4312-4441-845e-59ca0f2aa739 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.614746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e98ca0-d5ac-416b-8d0f-fdabcd9c0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.615399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e98ca0-d5ac-416b-8d0f-fdabcd9c0a00 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.615685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e98ca0-d5ac-416b-8d0f-fdabcd9c0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.615967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e98ca0-d5ac-416b-8d0f-fdabcd9c0a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.616693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e98ca0-d5ac-416b-8d0f-fdabcd9c0a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.618335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e98ca0-d5ac-416b-8d0f-fdabcd9c0a00 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.628777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1137/2264] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:50.632678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.642743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686c692-e778-4997-8c0d-f33456c824f7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.647426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727de1-83a0-401f-822b-952ae1b0d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.648303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727de1-83a0-401f-822b-952ae1b0d014 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.648587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727de1-83a0-401f-822b-952ae1b0d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.648873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727de1-83a0-401f-822b-952ae1b0d014 admin admin] PATH_INFO: `/v3/projects/9af19122497f4b8fba3c2f6faeb15ff7/users/dd9ea4774142452e9295179088925d73/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.664724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727de1-83a0-401f-822b-952ae1b0d014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af19122497f4b8fba3c2f6faeb15ff7, user_id=dd9ea4774142452e9295179088925d73, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.667851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727de1-83a0-401f-822b-952ae1b0d014 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.691973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1128/2265] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:50 2022] PUT /identity/v3/projects/9af19122497f4b8fba3c2f6faeb15ff7/users/dd9ea4774142452e9295179088925d73/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:50.701995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.702318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.702639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.731943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] MFA Rules not processed for user `dd9ea4774142452e9295179088925d73`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:50.735747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:50.757356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b9560-172b-4bb4-99be-3456a517a9af None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.757726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b9560-172b-4bb4-99be-3456a517a9af None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.758087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b9560-172b-4bb4-99be-3456a517a9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.777044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5c8b9560-172b-4bb4-99be-3456a517a9af None None] MFA Rules not processed for user `ae334c4d93cd4d3e94789a5985fcfa77`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:50.778376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5c8b9560-172b-4bb4-99be-3456a517a9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:50.791890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:50.823997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1138/2266] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:50.839425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:50.841695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:50.863225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1129/2267] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:50.916994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51eaf1-2e81-44ff-b938-376e13c66805 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:50.921723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6f4a-cf96-49b5-b4de-1675962e7f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:50.922406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6f4a-cf96-49b5-b4de-1675962e7f34 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:50.922729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6f4a-cf96-49b5-b4de-1675962e7f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:50.923039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6f4a-cf96-49b5-b4de-1675962e7f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:50.933962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6f4a-cf96-49b5-b4de-1675962e7f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:50.935554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6f4a-cf96-49b5-b4de-1675962e7f34 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:50.947092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1139/2268] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:53.488526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20877-5c1a-4457-acf3-953a3a548ccf None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.489060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20877-5c1a-4457-acf3-953a3a548ccf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.489142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20877-5c1a-4457-acf3-953a3a548ccf None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.491178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1130/2269] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:47:53.497830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27f093-6908-4f47-88e7-70b856164c39 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.498351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27f093-6908-4f47-88e7-70b856164c39 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.498470 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27f093-6908-4f47-88e7-70b856164c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.518246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ab27f093-6908-4f47-88e7-70b856164c39 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:53.519502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ab27f093-6908-4f47-88e7-70b856164c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.586912 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:53.604764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1140/2270] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:53.617718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20877-5c1a-4457-acf3-953a3a548ccf None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.619683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-91a20877-5c1a-4457-acf3-953a3a548ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.686740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20877-5c1a-4457-acf3-953a3a548ccf None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.691184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cbffc-ea10-4fc9-9eaf-30d55fcb56c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.691835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cbffc-ea10-4fc9-9eaf-30d55fcb56c6 service glance] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.692121 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cbffc-ea10-4fc9-9eaf-30d55fcb56c6 service glance] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.692398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cbffc-ea10-4fc9-9eaf-30d55fcb56c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.706490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cbffc-ea10-4fc9-9eaf-30d55fcb56c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.707973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cbffc-ea10-4fc9-9eaf-30d55fcb56c6 service glance] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.722476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1131/2271] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:53.795754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f1ae-0f88-4440-9ea3-36c3093f559d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.796073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f1ae-0f88-4440-9ea3-36c3093f559d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.796073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f1ae-0f88-4440-9ea3-36c3093f559d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.797428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1141/2272] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:47:53.804175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94713df-e0d5-4b3e-a225-0cb30b4f7a26 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.804469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94713df-e0d5-4b3e-a225-0cb30b4f7a26 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.804753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94713df-e0d5-4b3e-a225-0cb30b4f7a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.823716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a94713df-e0d5-4b3e-a225-0cb30b4f7a26 None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:53.824920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a94713df-e0d5-4b3e-a225-0cb30b4f7a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.882977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1132/2273] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:53.895708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f1ae-0f88-4440-9ea3-36c3093f559d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.897657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a1f9f1ae-0f88-4440-9ea3-36c3093f559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.912630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f1ae-0f88-4440-9ea3-36c3093f559d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.916357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd2938-37dd-41d4-bc01-b2f37c71691f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.916988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd2938-37dd-41d4-bc01-b2f37c71691f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.917270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd2938-37dd-41d4-bc01-b2f37c71691f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.917544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd2938-37dd-41d4-bc01-b2f37c71691f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.925573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd2938-37dd-41d4-bc01-b2f37c71691f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.927100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd2938-37dd-41d4-bc01-b2f37c71691f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.935165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1142/2274] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:54.030495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e23e37-e2f4-497f-8980-2d63cf5ec379 None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.030960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e23e37-e2f4-497f-8980-2d63cf5ec379 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.031410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e23e37-e2f4-497f-8980-2d63cf5ec379 None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.033568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1133/2275] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:47:54.042935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.043502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.043922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.067024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:54.068345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.079883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1143/2276] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:54.095148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e23e37-e2f4-497f-8980-2d63cf5ec379 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:54.097303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f3e23e37-e2f4-497f-8980-2d63cf5ec379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.111969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e23e37-e2f4-497f-8980-2d63cf5ec379 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:54.116066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d5213-8fa1-44b6-9059-5a0bb00e5a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:54.116717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5213-8fa1-44b6-9059-5a0bb00e5a1e service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.117022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5213-8fa1-44b6-9059-5a0bb00e5a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.117280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5213-8fa1-44b6-9059-5a0bb00e5a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.130073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d5213-8fa1-44b6-9059-5a0bb00e5a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:54.131726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d5213-8fa1-44b6-9059-5a0bb00e5a1e service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:54.144365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1134/2277] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:59.366022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:59.444506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739a2ff-9349-4904-bd80-3d9d5ad3385a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:59.449553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:59.450533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:59.450817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:59.451112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] PATH_INFO: `/v3/users/dd9ea4774142452e9295179088925d73` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:59.452388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9ea4774142452e9295179088925d73)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:59.456684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:59.575171 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9ea4774142452e9295179088925d73'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.599536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9ea4774142452e9295179088925d73'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.600289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9ea4774142452e9295179088925d73'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.601692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9ea4774142452e9295179088925d73'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.612297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9ea4774142452e9295179088925d73'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.643268 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1144/2278] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:59 2022] DELETE /identity/v3/users/dd9ea4774142452e9295179088925d73 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:59.647397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:59.648861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:59.649151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:59.691614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:59.693336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:59.822285 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:59.849711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1135/2279] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:59.918683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:59.920335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:00.053485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297583-d8fd-4413-b31e-491aee073a8c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.057449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c64c9-5403-40d8-8cb2-15a664731f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.058182 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c64c9-5403-40d8-8cb2-15a664731f5e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.058445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c64c9-5403-40d8-8cb2-15a664731f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.058728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c64c9-5403-40d8-8cb2-15a664731f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.071816 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c64c9-5403-40d8-8cb2-15a664731f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.072772 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c64c9-5403-40d8-8cb2-15a664731f5e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.077256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:00.087020 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1145/2280] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:01.102297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:01.104215 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:01.134733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192d04-28de-48b6-a300-2399575ea141 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:01.142726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:01.143593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.144049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.144162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] PATH_INFO: `/v3/projects/9af19122497f4b8fba3c2f6faeb15ff7` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:01.145851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af19122497f4b8fba3c2f6faeb15ff7)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:01.148823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:01.263544 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af19122497f4b8fba3c2f6faeb15ff7', 'request_id': 'req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.294101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af19122497f4b8fba3c2f6faeb15ff7', 'request_id': 'req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.304392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af19122497f4b8fba3c2f6faeb15ff7', 'request_id': 'req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.333728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] The token cache is being invalidate because project 9af19122497f4b8fba3c2f6faeb15ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:48:01.334100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.334799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.347879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1136/2281] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:48:01 2022] DELETE /identity/v3/projects/9af19122497f4b8fba3c2f6faeb15ff7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:01.821732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.822231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.822379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:01.843051 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:01.846405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:01.910490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1146/2282] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:48:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:01.923961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:01.925575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:02.050698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498a8f4-e0b2-48c1-826a-d50ed96b0ca9 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:02.056220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55190464-11bd-4b69-9cb1-f569ddf8a692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:02.057274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190464-11bd-4b69-9cb1-f569ddf8a692 service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:02.057274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190464-11bd-4b69-9cb1-f569ddf8a692 service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:02.057421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190464-11bd-4b69-9cb1-f569ddf8a692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:02.067814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55190464-11bd-4b69-9cb1-f569ddf8a692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:02.069659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55190464-11bd-4b69-9cb1-f569ddf8a692 service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:02.081355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1137/2283] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:48:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:48:11.902698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=26 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:12.076602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:18.301446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:18.303111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:18.437710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52a17-ba6c-4a27-9601-f0c3aafc0d36 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:18.449089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:18.450114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:18.450441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:18.450729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:18.452960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:18.471747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:18.475183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:18.502829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1147/2284] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:48:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:28.488793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=32 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:34.187716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:34.188208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:34.188319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:34.206857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:34.208162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:34.215364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1138/2285] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 19 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:34.238877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:34.251521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1113-e03a-494f-a440-e6a8cf03def8 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:34.256554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f59b-51dc-4bfa-aca4-0efd2a46b233 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:34.257196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f59b-51dc-4bfa-aca4-0efd2a46b233 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:34.257488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f59b-51dc-4bfa-aca4-0efd2a46b233 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:34.257766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f59b-51dc-4bfa-aca4-0efd2a46b233 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:34.267014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87f59b-51dc-4bfa-aca4-0efd2a46b233 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:34.268622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87f59b-51dc-4bfa-aca4-0efd2a46b233 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:34.277320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1148/2286] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:48:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:48:35.819362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:35.820900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:35.880008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb027f5-287e-4dd8-b4f9-d4e24b6e6810 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:35.883836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:35.884491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:35.884781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:35.885071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:35.886921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:35.952422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:35.954766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc0cd3-d545-4449-ac55-af61300bee80 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:35.964760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1139/2287] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:44.274014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:45.960177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=53 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:57.402248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df7771-775a-4c00-b18e-11c218fb4597 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:57.402774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df7771-775a-4c00-b18e-11c218fb4597 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:57.402888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df7771-775a-4c00-b18e-11c218fb4597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:57.420880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d6df7771-775a-4c00-b18e-11c218fb4597 None None] MFA Rules not processed for user `86bf2b338eac47f6bcf20a48770b2e01`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:57.422104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d6df7771-775a-4c00-b18e-11c218fb4597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:57.475873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1149/2288] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:07.468348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=25 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:42.003375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724de5-a9ff-487c-a5b8-614e73ad7982 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:42.004022 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724de5-a9ff-487c-a5b8-614e73ad7982 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:42.004123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724de5-a9ff-487c-a5b8-614e73ad7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:42.021886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-86724de5-a9ff-487c-a5b8-614e73ad7982 None None] MFA Rules not processed for user `2d7c42cf0bc84292bb0b7edb9f2e7fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:49:42.023175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-86724de5-a9ff-487c-a5b8-614e73ad7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:42.077882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1140/2289] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:45.829752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:45.830409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:45.830409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:45.859829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] MFA Rules not processed for user `fca86639f2d344be97cb1529dc17f62a`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:49:45.861515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:45.936706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1150/2290] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:52.071157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=25 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:54.056950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:54.057480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:54.057480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:54.087653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] MFA Rules not processed for user `4785719411fd4af892868d99fca7cd71`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:49:54.089221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:54.164310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1141/2291] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:55.924829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=25 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:01.823740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:01.826208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:01.909784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512ecc-d19e-4d6c-8870-24b0e97d16f4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:01.915862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:01.916753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:01.917174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:01.917465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] PATH_INFO: `/v3/users/86bf2b338eac47f6bcf20a48770b2e01` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:01.918733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86bf2b338eac47f6bcf20a48770b2e01)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:01.920885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:01.978732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86bf2b338eac47f6bcf20a48770b2e01'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:01.994600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86bf2b338eac47f6bcf20a48770b2e01'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:01.995858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86bf2b338eac47f6bcf20a48770b2e01'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:01.996778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86bf2b338eac47f6bcf20a48770b2e01'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.008265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86bf2b338eac47f6bcf20a48770b2e01'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.023745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1151/2292] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:50:01 2022] DELETE /identity/v3/users/86bf2b338eac47f6bcf20a48770b2e01 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:50:02.235209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:02.249654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cb990-75a9-4381-bd55-3e4022a8547c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:02.362027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:02.363009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:02.363298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:02.363582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] PATH_INFO: `/v3/projects/41bf5203b925421b9dd2ccc5b7d40ad8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:02.364892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bf5203b925421b9dd2ccc5b7d40ad8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:02.366993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:02.444174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bf5203b925421b9dd2ccc5b7d40ad8', 'request_id': 'req-706e98b7-2c48-4603-9955-dd35c46b240f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.459607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bf5203b925421b9dd2ccc5b7d40ad8', 'request_id': 'req-706e98b7-2c48-4603-9955-dd35c46b240f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.466522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bf5203b925421b9dd2ccc5b7d40ad8', 'request_id': 'req-706e98b7-2c48-4603-9955-dd35c46b240f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.477774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] The token cache is being invalidate because project 41bf5203b925421b9dd2ccc5b7d40ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:50:02.478064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.478736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:50:02.480294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1142/2293] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:50:02 2022] DELETE /identity/v3/projects/41bf5203b925421b9dd2ccc5b7d40ad8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:50:12.019693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:12.474640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:39.912213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:39.913671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:39.977015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8660d1-8352-45a5-968b-931b3500a823 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:40.025318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:40.025964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:40.026251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:40.026558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:40.028371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:40.087178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:40.088611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:40.098601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1152/2294] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:40.201836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:40.203813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:40.215971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e98b7-2c48-4603-9955-dd35c46b240f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:40.220111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:40.220746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:40.221026 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:40.221302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:40.223032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:40.297585 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:40.299141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:40.310389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1143/2295] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:41.783942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:41.785513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:41.845357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef99da-9155-484c-8066-c420befe3c5d service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:41.849140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:41.849789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:41.850077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:41.850379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:41.852209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:41.866136 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:41.867622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:41.880042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1153/2296] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:50:43.419987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:43.422124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:43.435919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178594f9-e9b6-429c-a0a5-f9ad9c532888 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:43.441794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:43.442471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:43.442764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:43.443050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:43.444777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:43.502528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:43.504149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:43.513882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1144/2297] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:46.677408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:46.679638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:46.695077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173452b-7928-4586-9262-5a784c2bed0b service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:46.701636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:46.702316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:46.703328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:46.704789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:46.708496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:46.720914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:46.781902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:46.784174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:46.800902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1154/2298] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:48.001050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:48.023134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b8f1e-b497-46bd-b35e-23d2ef97a1ee service nova] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:48.032649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:48.035073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:48.035597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:48.036005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:48.038484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:48.070095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:48.090560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c47bb6-e419-4f11-b084-7da1f81e2075 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:48.097760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:48.103253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb570a3-5801-40cc-8d51-635ea0e34229 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:48.126263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:48.127255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:48.127715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:48.128174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:48.136399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:48.138736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1145/2299] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:48.181688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:48.183676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:48.212455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1155/2300] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:50:51.556329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:51.556842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:51.556942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:51.574966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] MFA Rules not processed for user `d9c75043813844d79fd0764132dfe4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:50:51.576172 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:51.632057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1146/2301] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:50:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:50:51.953177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:51.954735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:51.965994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b603d-d7c5-4083-8321-177706805eaf service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:51.970394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:51.971024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:51.971312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:51.971593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:51.973306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:51.982455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:51.983934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:51.993125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1156/2302] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:52.328621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:52.330036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:52.350060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:52.407194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b22b1b-fa68-4d7b-8624-955b646b4a7a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:52.412716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:52.413374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:52.413663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:52.413946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:52.416157 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:52.431827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:52.433416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:52.443303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1147/2303] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:56.035474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:56.052371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e33e1-b4ec-4708-b8f6-0a7cb83e47da service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:56.057345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:56.058595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:56.059140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:56.059593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:56.061436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:56.075467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:56.077205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:56.086887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1157/2304] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:01.857424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:01.867188 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf5d9e-0057-44a6-8664-65310f35c189 service placement] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:01.870891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:01.871474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:01.871762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:01.872043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:01.873822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:01.936531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:01.938639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6e474-f2b2-4cc5-ba37-7bc3d9c95038 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:01.948461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1148/2305] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:51:02.672018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:02.692530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076a1ff-5b0a-4e26-86ca-dccccb3a3858 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:02.698721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:02.699673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:02.700110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:02.700539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:02.702618 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:02.717728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:02.720042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:02.732851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1158/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:03.756212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:03.756765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:03.756765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:03.783231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:03.785020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:03.873581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1149/2307] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:03.964810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:03.969435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:04.080001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ba18e-f577-4e63-8325-bbfc13d78120 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:04.098893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2804c-96e5-4592-925a-b283134a801f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:04.100853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2804c-96e5-4592-925a-b283134a801f service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:04.101393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2804c-96e5-4592-925a-b283134a801f service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:04.101907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2804c-96e5-4592-925a-b283134a801f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:04.115681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2804c-96e5-4592-925a-b283134a801f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:04.118959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2804c-96e5-4592-925a-b283134a801f service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:04.144843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1159/2308] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:09.149575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:09.160680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:09.192967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7654cc-1e73-47cf-8a1f-da97f85b9fc8 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:09.206431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:09.207954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:09.209368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:09.211473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] PATH_INFO: `/v3/users/4785719411fd4af892868d99fca7cd71` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:09.213701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4785719411fd4af892868d99fca7cd71)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:09.216947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:09.362061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:09.382032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4785719411fd4af892868d99fca7cd71'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:09.383355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4785719411fd4af892868d99fca7cd71'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:09.415044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4785719411fd4af892868d99fca7cd71'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:09.416828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4785719411fd4af892868d99fca7cd71'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:09.442148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4785719411fd4af892868d99fca7cd71'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:09.469340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1150/2309] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:09 2022] DELETE /identity/v3/users/4785719411fd4af892868d99fca7cd71 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:10.212229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721da78-6b9f-431a-9c2e-4ac156fbc4ba None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:10.212776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721da78-6b9f-431a-9c2e-4ac156fbc4ba None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:10.212776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721da78-6b9f-431a-9c2e-4ac156fbc4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:10.247603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a721da78-6b9f-431a-9c2e-4ac156fbc4ba None None] MFA Rules not processed for user `ae334c4d93cd4d3e94789a5985fcfa77`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:10.248848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a721da78-6b9f-431a-9c2e-4ac156fbc4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:10.396284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:10.417836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1160/2310] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:10.985147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:10.987434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:11.149667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136086ba-dabb-4a09-ab70-4c35d1443ddf admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:11.165663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:11.167261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.167800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.168089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] PATH_INFO: `/v3/projects/a872b4eafae74b82896bd09229152104` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.172772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a872b4eafae74b82896bd09229152104)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:11.174851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:11.291957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a872b4eafae74b82896bd09229152104', 'request_id': 'req-3ad8552e-8560-4a5c-ae37-40aabc335b6e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:11.312656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a872b4eafae74b82896bd09229152104', 'request_id': 'req-3ad8552e-8560-4a5c-ae37-40aabc335b6e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:11.323788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a872b4eafae74b82896bd09229152104', 'request_id': 'req-3ad8552e-8560-4a5c-ae37-40aabc335b6e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:11.345466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] The token cache is being invalidate because project a872b4eafae74b82896bd09229152104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:11.345796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:11.348975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3ad8552e-8560-4a5c-ae37-40aabc335b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:11.355176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1151/2311] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:10 2022] DELETE /identity/v3/projects/a872b4eafae74b82896bd09229152104 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:11.361543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09f60-7afc-474b-8d9b-2c1dc8923107 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.362096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09f60-7afc-474b-8d9b-2c1dc8923107 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.362096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09f60-7afc-474b-8d9b-2c1dc8923107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.397307 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-65c09f60-7afc-474b-8d9b-2c1dc8923107 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:11.398740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-65c09f60-7afc-474b-8d9b-2c1dc8923107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:11.471248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.471547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.471908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.507502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] MFA Rules not processed for user `2d7c42cf0bc84292bb0b7edb9f2e7fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:11.508658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:11.536107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1161/2312] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:11.544455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.545887 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.546492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.588917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:11.592150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:11.612867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1162/2313] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:51:11.617524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:11.634326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:11.637741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af32aa-2d26-410c-9763-9722da72a28c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:11.650253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:11.650933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.653261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.653564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.656734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:51:11.657087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:11.658777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:11.663952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1152/2314] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:11.691764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:11.699781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1163/2315] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:51:11.706330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e94f-e792-48b6-b967-68e2686bb2d9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:11.713393 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:11.714764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.714764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.714974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.715748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:11.722627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:11.781294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1153/2316] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:11 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:11.786747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:11.803281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a42abf-3131-4500-8a0d-1f5878e1bd13 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:11.958865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:11.960014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:11.960495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:11.961604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:11.962519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:11.964789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:12.017764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1164/2317] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:11 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:12.021601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:12.037825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4940ed-6008-42cb-810f-604563815b13 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:12.043743 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:12.044699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:12.045143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:12.045610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:12.046642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:12.055561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:12.073138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1154/2318] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:12.076797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:12.093825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa8b05-c4ca-49ff-b78a-68571a0cfab7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:12.118032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cfc57-ff55-4393-9f36-39051b3a2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:12.119165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cfc57-ff55-4393-9f36-39051b3a2402 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:12.119626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cfc57-ff55-4393-9f36-39051b3a2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:12.120088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cfc57-ff55-4393-9f36-39051b3a2402 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:12.121015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cfc57-ff55-4393-9f36-39051b3a2402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:12.124160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cfc57-ff55-4393-9f36-39051b3a2402 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:12.161399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1165/2319] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:12.165843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:12.177360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea58d4-52b3-447d-9c97-6e60106e65f6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:12.188233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:12.189716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:12.190814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:12.191325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] PATH_INFO: `/v3/projects/afc6b4c487d8495c893fa0f80d8fa4a2/users/11ebed317b0f45d9af3599153809ff86/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:12.214501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc6b4c487d8495c893fa0f80d8fa4a2, user_id=11ebed317b0f45d9af3599153809ff86, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:12.220740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:12.251955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1155/2320] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:12 2022] PUT /identity/v3/projects/afc6b4c487d8495c893fa0f80d8fa4a2/users/11ebed317b0f45d9af3599153809ff86/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:12.261886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:12.262577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:12.263080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:12.366712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] MFA Rules not processed for user `11ebed317b0f45d9af3599153809ff86`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:12.370559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:12.500140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:12.523720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:12.525554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:12.550604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1166/2321] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:12.561655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:12.565097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:12.661856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8397-ea0d-482a-beec-fb1a5bab5609 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:12.673803 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:12.675513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:12.676299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:12.677366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:12.689468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:12.712787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:12.721908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:12.731629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946091d9-f3ce-4f4f-be73-322af239517a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:12.740711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5c50a-47d2-4148-8d78-7c776f9065f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:12.741739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5c50a-47d2-4148-8d78-7c776f9065f1 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:12.742178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5c50a-47d2-4148-8d78-7c776f9065f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:12.742586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5c50a-47d2-4148-8d78-7c776f9065f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:12.753546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5c50a-47d2-4148-8d78-7c776f9065f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:12.755559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5c50a-47d2-4148-8d78-7c776f9065f1 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:12.759007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1156/2322] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:51:12.767508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1167/2323] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:15.118702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:15.273428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a6153-cdb2-477a-96f3-bc327202d55f service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:15.280243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:15.283941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:15.284234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:15.284537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] PATH_INFO: `/v3/users/11ebed317b0f45d9af3599153809ff86` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:15.285916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ebed317b0f45d9af3599153809ff86)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:15.288071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:15.376442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:15.392429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ebed317b0f45d9af3599153809ff86'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:15.393685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ebed317b0f45d9af3599153809ff86'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:15.411843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ebed317b0f45d9af3599153809ff86'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:15.412621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ebed317b0f45d9af3599153809ff86'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:15.426770 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ebed317b0f45d9af3599153809ff86'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:15.466732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1157/2324] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:15 2022] DELETE /identity/v3/users/11ebed317b0f45d9af3599153809ff86 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:15.468621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:15.469698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:15.470149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:15.505041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:15.507520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:15.674977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1168/2325] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:51:15.683571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:15.689015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:15.854250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ac4c4-38b6-4ab7-b78b-f9cf9b570e96 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:15.864142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c7df6-2479-4350-badc-efe9f5a4aa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:15.865209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7df6-2479-4350-badc-efe9f5a4aa54 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:15.866326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7df6-2479-4350-badc-efe9f5a4aa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:15.866852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7df6-2479-4350-badc-efe9f5a4aa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:15.884702 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c7df6-2479-4350-badc-efe9f5a4aa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:15.886380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c7df6-2479-4350-badc-efe9f5a4aa54 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:15.899758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1158/2326] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:16.869671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:16.871177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:16.894281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1572c-85d2-4c7e-bf74-b4720afa6be9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:16.899608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:16.900492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:16.900777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:16.901245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] PATH_INFO: `/v3/projects/afc6b4c487d8495c893fa0f80d8fa4a2` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:16.902671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc6b4c487d8495c893fa0f80d8fa4a2)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:16.904782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:16.977136 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc6b4c487d8495c893fa0f80d8fa4a2', 'request_id': 'req-48d4a960-2907-4613-a4c9-3636660666e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:16.983164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc6b4c487d8495c893fa0f80d8fa4a2', 'request_id': 'req-48d4a960-2907-4613-a4c9-3636660666e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:16.999786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc6b4c487d8495c893fa0f80d8fa4a2', 'request_id': 'req-48d4a960-2907-4613-a4c9-3636660666e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:17.002409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:17.044739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] The token cache is being invalidate because project afc6b4c487d8495c893fa0f80d8fa4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:17.047658 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:17.049621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-48d4a960-2907-4613-a4c9-3636660666e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:17.052931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1169/2327] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:16 2022] DELETE /identity/v3/projects/afc6b4c487d8495c893fa0f80d8fa4a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:17.059279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.060548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.061068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.091209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:17.098289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:17.188618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1159/2328] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:17.190297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.190619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.190901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.220865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:17.222502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:17.243026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1170/2329] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:17.244210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:17.256637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1200-e835-4464-bef1-c6db4578d2cf None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:17.272352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:17.274917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.274917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.274917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.275270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:51:17.275660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:17.277466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:17.312625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:17.315014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1160/2330] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:51:17.330543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff13a6c-c38f-4d3b-aa60-c9bb53de4c62 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:17.343968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:17.344252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.346881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.347374 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.350955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:17.353181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:17.411280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1171/2331] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:17 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:17.415903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:17.435493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8904d-5694-438e-b258-4efe0c581cd2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:17.555835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:17.584014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:17.584771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.585063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.585350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.586288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:17.588372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:17.633915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1161/2332] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:17 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:17.635666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:17.653508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed869bc5-7095-4cb6-96fe-f5c6dc179933 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:17.667337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:17.668710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.669217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.669678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.670621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:17.673879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:17.688133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1172/2333] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:17.691851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:17.710086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35634c0-e646-4e6a-aab1-d95150116996 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:17.717911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2830a-f949-4fbc-87cf-b58e1a5df1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:17.721033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2830a-f949-4fbc-87cf-b58e1a5df1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.721561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2830a-f949-4fbc-87cf-b58e1a5df1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.722119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2830a-f949-4fbc-87cf-b58e1a5df1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.723031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2830a-f949-4fbc-87cf-b58e1a5df1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:17.724883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2830a-f949-4fbc-87cf-b58e1a5df1b4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:17.741435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1162/2334] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:17.742321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:17.755063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8267a1-61c1-47bb-8e95-65fa52eb6359 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:17.769170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:17.770161 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.770497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.770759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] PATH_INFO: `/v3/projects/ceae12934696470ba3f336518748b3a6/users/ed7afd5f543c40aeb8b7dd86f8408993/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.811570 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceae12934696470ba3f336518748b3a6, user_id=ed7afd5f543c40aeb8b7dd86f8408993, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:17.817914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:17.844891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1173/2335] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:17 2022] PUT /identity/v3/projects/ceae12934696470ba3f336518748b3a6/users/ed7afd5f543c40aeb8b7dd86f8408993/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:17.857057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:17.857466 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:17.857860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:17.910852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] MFA Rules not processed for user `ed7afd5f543c40aeb8b7dd86f8408993`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:17.912669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:18.067424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1163/2336] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:18.072549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.160902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ff3c-2d7f-4a5c-bbc5-c6f613ca209a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:18.167340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:18.168209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.168503 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.168785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.169501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:18.172960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:18.221677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1174/2337] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:18 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:18.225650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.240692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca5723-f600-4c85-ba59-79d19c63315b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:18.356786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:18.357873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.358169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.358502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.361122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:18.363580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:18.402312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1164/2338] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:18 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:18.406500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.417452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73061a-8cb6-4a25-a1e6-1a416c644d9d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:18.422856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:18.423534 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.423821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.424105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.424844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:18.428273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:18.442261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.457609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1175/2339] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:18.460896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c4b8-9abc-466c-a6f6-d0b84ce07631 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:18.467844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f86148-60a5-48c0-873d-d52b1f6d3396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:18.468766 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f86148-60a5-48c0-873d-d52b1f6d3396 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.468954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f86148-60a5-48c0-873d-d52b1f6d3396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.469240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f86148-60a5-48c0-873d-d52b1f6d3396 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.469980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f86148-60a5-48c0-873d-d52b1f6d3396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:18.471651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f86148-60a5-48c0-873d-d52b1f6d3396 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:18.486057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1165/2340] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:18.490303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.510725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442e27-32ff-4d21-86e9-8ff71e07e15e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:18.520538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:18.521726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.522280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.522754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] PATH_INFO: `/v3/projects/af37468b9d6c4d25b249dad2af49e169/users/7a52ac498b844fa6982a9bec22b1f959/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.562955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af37468b9d6c4d25b249dad2af49e169, user_id=7a52ac498b844fa6982a9bec22b1f959, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:18.566490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:18.598215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1176/2341] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:18 2022] PUT /identity/v3/projects/af37468b9d6c4d25b249dad2af49e169/users/7a52ac498b844fa6982a9bec22b1f959/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:18.603836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.604134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.604412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.655118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] MFA Rules not processed for user `7a52ac498b844fa6982a9bec22b1f959`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:18.657616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:18.709000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:18.778893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1166/2342] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:18.784122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.864000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:18.895302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676fdd5-2dde-4e98-a9e0-a0ad90acdbe2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:18.910030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:18.910969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:18.911373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:18.912324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:18.912598 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:18.914694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:18.974130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1177/2343] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:18 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:18.978578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:18.996870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa7dc-ab97-4df1-aacd-3b7b4d68ca38 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:19.095940 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:19.099539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.102144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.102477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.103450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:19.106495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:19.136998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1167/2344] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:18 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:19.141253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:19.153108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea35f6-6089-4c3a-b39d-a80271a50b3d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:19.158436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:19.159927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.159927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.160210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.160746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:19.162574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:19.180672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1178/2345] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:19.184542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:19.197572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b61aab-a005-4623-ab82-5f83f6d6a1e6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:19.206005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:19.207076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.207842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.207842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] PATH_INFO: `/v3/projects/532f511c9bcd416dbc4e4db01567bbd4/users/aeae7b7a42ce4375864a27390713865c/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.229233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532f511c9bcd416dbc4e4db01567bbd4, user_id=aeae7b7a42ce4375864a27390713865c, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:19.232712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:19.256059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1168/2346] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:19 2022] PUT /identity/v3/projects/532f511c9bcd416dbc4e4db01567bbd4/users/aeae7b7a42ce4375864a27390713865c/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:19.259867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:19.271583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a87cd4-2239-4ee1-8563-446dc6a81f5b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:19.363261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c627-fe75-4b1d-83c4-68b86f2d9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:19.363959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c627-fe75-4b1d-83c4-68b86f2d9810 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.364247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c627-fe75-4b1d-83c4-68b86f2d9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.364527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c627-fe75-4b1d-83c4-68b86f2d9810 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.365284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c627-fe75-4b1d-83c4-68b86f2d9810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:19.367034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c627-fe75-4b1d-83c4-68b86f2d9810 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:19.381193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1179/2347] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:19.384435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:19.396621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8957f1e-fb9b-4a3e-9495-e75d29fdaa74 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:19.401760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:19.402864 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.403153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.403434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] PATH_INFO: `/v3/projects/532f511c9bcd416dbc4e4db01567bbd4/users/aeae7b7a42ce4375864a27390713865c/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.406168 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532f511c9bcd416dbc4e4db01567bbd4, user_id=aeae7b7a42ce4375864a27390713865c, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:19.409355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:19.424671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1169/2348] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:19 2022] PUT /identity/v3/projects/532f511c9bcd416dbc4e4db01567bbd4/users/aeae7b7a42ce4375864a27390713865c/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:51:19.434727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.435026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.435313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.494594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] MFA Rules not processed for user `aeae7b7a42ce4375864a27390713865c`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:19.495855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:19.578180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1180/2349] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:19.589956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:19.591755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:19.695523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2e13-0120-483a-b5c4-ffaa4a604fe6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:19.699624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:19.700406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:19.700800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:19.701185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:19.711906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:19.713347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:19.738585 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1170/2350] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:20.394923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:20.396407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:20.410457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf168-ba02-43a9-9876-56864b02cf39 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:20.415153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1fbdb-ef81-403a-8b4c-0741c9652c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:20.415809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1fbdb-ef81-403a-8b4c-0741c9652c76 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:20.416088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1fbdb-ef81-403a-8b4c-0741c9652c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:20.416494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1fbdb-ef81-403a-8b4c-0741c9652c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:20.450690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:20.482211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1fbdb-ef81-403a-8b4c-0741c9652c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:20.483632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1fbdb-ef81-403a-8b4c-0741c9652c76 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:20.495104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1181/2351] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:24.585175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:24.598603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c16226-5699-405d-9dd1-e166385b8f38 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:24.602463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87481f5-c6b4-4903-a742-6c57a87ca6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:24.603311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87481f5-c6b4-4903-a742-6c57a87ca6dc service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:24.603436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87481f5-c6b4-4903-a742-6c57a87ca6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:24.603731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87481f5-c6b4-4903-a742-6c57a87ca6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:24.627475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:24.703299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87481f5-c6b4-4903-a742-6c57a87ca6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:24.705225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87481f5-c6b4-4903-a742-6c57a87ca6dc service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:24.722656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1171/2352] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:25.500067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d9b0-c7c8-4df8-9174-5428079e5edc None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:25.500705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d9b0-c7c8-4df8-9174-5428079e5edc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:25.500830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d9b0-c7c8-4df8-9174-5428079e5edc None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:25.502345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1182/2353] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:51:25.511625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07d42-c405-47fd-a753-96ce31136e59 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:25.512033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07d42-c405-47fd-a753-96ce31136e59 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:25.512443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07d42-c405-47fd-a753-96ce31136e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:25.533513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-66c07d42-c405-47fd-a753-96ce31136e59 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:25.534847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-66c07d42-c405-47fd-a753-96ce31136e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:25.616808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1172/2354] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:25.629088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d9b0-c7c8-4df8-9174-5428079e5edc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:25.630970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-21b9d9b0-c7c8-4df8-9174-5428079e5edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:25.699333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d9b0-c7c8-4df8-9174-5428079e5edc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:25.703763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb9a2-aa4b-4624-a1ab-060e6c4265c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:25.704408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb9a2-aa4b-4624-a1ab-060e6c4265c6 service glance] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:25.704705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb9a2-aa4b-4624-a1ab-060e6c4265c6 service glance] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:25.704984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb9a2-aa4b-4624-a1ab-060e6c4265c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:25.716455 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb9a2-aa4b-4624-a1ab-060e6c4265c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:25.718491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb9a2-aa4b-4624-a1ab-060e6c4265c6 service glance] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:25.729526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1183/2355] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:25.804600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6faa14-6941-4663-9b7d-056af6310ebc None None] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:25.804896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6faa14-6941-4663-9b7d-056af6310ebc None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:25.805185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6faa14-6941-4663-9b7d-056af6310ebc None None] PATH_INFO: `/` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:25.806590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1173/2356] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:51:25.811656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48311174-be55-4a3e-b60b-4abe86694294 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:25.812802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48311174-be55-4a3e-b60b-4abe86694294 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:25.813137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48311174-be55-4a3e-b60b-4abe86694294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:25.833076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-48311174-be55-4a3e-b60b-4abe86694294 None None] MFA Rules not processed for user `4c7f97cf493c4b118a96025ee33f27a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:25.834429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-48311174-be55-4a3e-b60b-4abe86694294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:25.891719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1184/2357] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:25.903373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6faa14-6941-4663-9b7d-056af6310ebc None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:25.905136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0c6faa14-6941-4663-9b7d-056af6310ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:25.920180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6faa14-6941-4663-9b7d-056af6310ebc None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:25.928076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b544fa-1d31-4c0f-9309-29b6f35cff2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:25.928732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b544fa-1d31-4c0f-9309-29b6f35cff2b service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:25.929020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b544fa-1d31-4c0f-9309-29b6f35cff2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:25.929304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b544fa-1d31-4c0f-9309-29b6f35cff2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:25.936726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b544fa-1d31-4c0f-9309-29b6f35cff2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:25.938230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b544fa-1d31-4c0f-9309-29b6f35cff2b service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:25.945992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1174/2358] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:26.031227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fc43-e052-4059-855f-57f2118b163f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:26.031625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fc43-e052-4059-855f-57f2118b163f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:26.031907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fc43-e052-4059-855f-57f2118b163f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:26.033277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1185/2359] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 19 15:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:51:26.038647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:26.038950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:26.039240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:26.057646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] MFA Rules not processed for user `a3981687a6c741afbd3d22eb49fe4da7`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:26.058882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:26.068947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1175/2360] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 19 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:26.080080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058fc43-e052-4059-855f-57f2118b163f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:26.090958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058fc43-e052-4059-855f-57f2118b163f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:26.094543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb07440-f3a0-46dd-b4be-61235bff5f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:26.095168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb07440-f3a0-46dd-b4be-61235bff5f56 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:26.095450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb07440-f3a0-46dd-b4be-61235bff5f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:26.095725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb07440-f3a0-46dd-b4be-61235bff5f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:26.105724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb07440-f3a0-46dd-b4be-61235bff5f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:26.107160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb07440-f3a0-46dd-b4be-61235bff5f56 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:26.118098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1186/2361] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:27.078715 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:27.145870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f81e1-2ab4-4eff-8283-ba2ba5937160 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:27.150519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:27.151398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:27.151677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:27.151950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] PATH_INFO: `/v3/users/ed7afd5f543c40aeb8b7dd86f8408993` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:27.153142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7afd5f543c40aeb8b7dd86f8408993)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:27.155151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:27.197099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:27.220376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7afd5f543c40aeb8b7dd86f8408993'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:27.221054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7afd5f543c40aeb8b7dd86f8408993'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:27.229574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7afd5f543c40aeb8b7dd86f8408993'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:27.230294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7afd5f543c40aeb8b7dd86f8408993'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:27.239443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7afd5f543c40aeb8b7dd86f8408993'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:27.261603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1176/2362] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:27 2022] DELETE /identity/v3/users/ed7afd5f543c40aeb8b7dd86f8408993 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:27.266402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a9e6-b008-4d07-b89a-1735a31a5302 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:27.266968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a9e6-b008-4d07-b89a-1735a31a5302 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:27.266968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a9e6-b008-4d07-b89a-1735a31a5302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:27.286152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-76e7a9e6-b008-4d07-b89a-1735a31a5302 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:27.287410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-76e7a9e6-b008-4d07-b89a-1735a31a5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:27.363186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1187/2363] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:27.379516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:27.382077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:27.475953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4446-ec68-4580-b35e-1971167d5ae2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:27.479714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:27.480381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:27.480670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:27.480955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:27.496241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:27.498054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:27.512287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1177/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:28.267220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:28.267645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:28.267790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:28.281369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:28.284368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:28.297302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:28.298530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b519fe-f653-48b5-a651-06273c114947 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:28.299005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:28.305580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:28.311001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:28.312684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:28.313069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:28.313733 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] PATH_INFO: `/v3/projects/ceae12934696470ba3f336518748b3a6` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:28.315456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceae12934696470ba3f336518748b3a6)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:28.317685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:28.370654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceae12934696470ba3f336518748b3a6', 'request_id': 'req-77046c5c-bd53-48eb-bbae-90c797f6b9c1'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.378701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1188/2365] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:28.384473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceae12934696470ba3f336518748b3a6', 'request_id': 'req-77046c5c-bd53-48eb-bbae-90c797f6b9c1'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.395814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceae12934696470ba3f336518748b3a6', 'request_id': 'req-77046c5c-bd53-48eb-bbae-90c797f6b9c1'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.397359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:28.399243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:28.414581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] The token cache is being invalidate because project ceae12934696470ba3f336518748b3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:28.414874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.415741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.420877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1178/2366] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:28 2022] DELETE /identity/v3/projects/ceae12934696470ba3f336518748b3a6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:28.422485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:28.424436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:28.487708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:28.514255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f4dc-98f6-4a51-aeb0-79302ba3d4c6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:28.545593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046c5c-bd53-48eb-bbae-90c797f6b9c1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:28.551317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:28.552337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:28.552728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:28.553109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] PATH_INFO: `/v3/users/7a52ac498b844fa6982a9bec22b1f959` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:28.554591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a52ac498b844fa6982a9bec22b1f959)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:28.556669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:28.601301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:28.602005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:28.602266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:28.602596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:28.604464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:28.643740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a52ac498b844fa6982a9bec22b1f959'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.644515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a52ac498b844fa6982a9bec22b1f959'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.653800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a52ac498b844fa6982a9bec22b1f959'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.655704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a52ac498b844fa6982a9bec22b1f959'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.675572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a52ac498b844fa6982a9bec22b1f959'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:28.704001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:28.706801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:28.712184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1179/2367] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:28 2022] DELETE /identity/v3/users/7a52ac498b844fa6982a9bec22b1f959 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:28.718746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:28.731416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1189/2368] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:51:29.331727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:29.333861 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:29.439972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af6492-b453-4593-b5f5-fc30836da5fb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:29.446999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:29.448230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:29.448621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:29.449005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] PATH_INFO: `/v3/projects/af37468b9d6c4d25b249dad2af49e169` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:29.461248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af37468b9d6c4d25b249dad2af49e169)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:29.479684 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:29.586975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af37468b9d6c4d25b249dad2af49e169', 'request_id': 'req-62a0ee53-a8b7-4045-9358-7b7a13d60350'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:29.601646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:29.611947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af37468b9d6c4d25b249dad2af49e169', 'request_id': 'req-62a0ee53-a8b7-4045-9358-7b7a13d60350'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:29.627400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af37468b9d6c4d25b249dad2af49e169', 'request_id': 'req-62a0ee53-a8b7-4045-9358-7b7a13d60350'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:29.652992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] The token cache is being invalidate because project af37468b9d6c4d25b249dad2af49e169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:29.653359 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:29.654073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:29.659281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1180/2369] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:29 2022] DELETE /identity/v3/projects/af37468b9d6c4d25b249dad2af49e169 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:29.660500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:29.706411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272925b3-bd32-4fa1-ba45-261596e3ab8f service swift] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:29.857327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:29.858409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:29.859534 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:29.861309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] PATH_INFO: `/v3/users/aeae7b7a42ce4375864a27390713865c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:29.867260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeae7b7a42ce4375864a27390713865c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:29.869491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:29.978063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeae7b7a42ce4375864a27390713865c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.000120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeae7b7a42ce4375864a27390713865c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.001533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeae7b7a42ce4375864a27390713865c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.002919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeae7b7a42ce4375864a27390713865c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.037138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6e111019-ccaa-492d-bbdb-7f135a560578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeae7b7a42ce4375864a27390713865c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.055406 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1190/2370] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:29 2022] DELETE /identity/v3/users/aeae7b7a42ce4375864a27390713865c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:30.539077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:30.541470 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:30.563493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0ee53-a8b7-4045-9358-7b7a13d60350 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:30.699115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:30.700514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:30.701129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:30.701662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] PATH_INFO: `/v3/projects/532f511c9bcd416dbc4e4db01567bbd4` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:30.703995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=532f511c9bcd416dbc4e4db01567bbd4)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:30.706418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:30.796932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532f511c9bcd416dbc4e4db01567bbd4', 'request_id': 'req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.808394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532f511c9bcd416dbc4e4db01567bbd4', 'request_id': 'req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.823672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532f511c9bcd416dbc4e4db01567bbd4', 'request_id': 'req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.842736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] The token cache is being invalidate because project 532f511c9bcd416dbc4e4db01567bbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:30.844374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.845932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ddbf11bd-06e1-4df5-bc16-f24acd63d01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:30.854938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:30.855467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:30.855587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1181/2371] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:30 2022] DELETE /identity/v3/projects/532f511c9bcd416dbc4e4db01567bbd4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:30.855685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:30.890001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:30.892095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:31.004256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1191/2372] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:31.012979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.017211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.017788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.097004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:31.098576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:31.109431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1182/2373] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:31.114674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.131355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509df78-61ac-4c51-a58c-8fd65d5184d9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.136196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.136923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.137170 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.137450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.138192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:51:31.138611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.143996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.164340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1192/2374] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:51:31.168731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.189148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78a067-169e-4ad6-8256-1557d6b13c18 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.195546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.196227 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.196514 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.196793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.198040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.199479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.235699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1183/2375] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:31 2022] POST /identity/v3/projects => generated 361 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:31.236558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.254540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908863e-22b7-4159-b3fe-552debaed8e4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.258514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:31.340567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.341166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.341465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.341734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.342475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.345175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.374707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1193/2376] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:31 2022] POST /identity/v3/users => generated 281 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:51:31.376986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.391567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009c66d-56f8-4ef2-ac1a-978909f83487 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.397050 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.397749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.398018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.398303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.399092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.400712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.413254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1184/2377] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:31.417674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.428214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f359d-15d4-4ab1-ab9e-5a4e6f703bdc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.435891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52a8c5-bcb3-4b58-b313-7d71928978dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.436577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52a8c5-bcb3-4b58-b313-7d71928978dd admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.437569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52a8c5-bcb3-4b58-b313-7d71928978dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.437973 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52a8c5-bcb3-4b58-b313-7d71928978dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.438751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52a8c5-bcb3-4b58-b313-7d71928978dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.440368 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52a8c5-bcb3-4b58-b313-7d71928978dd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.451558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1194/2378] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:31.455767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.466826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd4523-0d72-48b5-8274-665c500a3e92 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.472588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.473691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.474051 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.474535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] PATH_INFO: `/v3/projects/60993b299e4f4545aa3a577163bf5a7f/users/4cf28eec72a8493d8ae1117fc1fd6402/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.492345 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60993b299e4f4545aa3a577163bf5a7f, user_id=4cf28eec72a8493d8ae1117fc1fd6402, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.496269 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.514884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1185/2379] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:31 2022] PUT /identity/v3/projects/60993b299e4f4545aa3a577163bf5a7f/users/4cf28eec72a8493d8ae1117fc1fd6402/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:51:31.526806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.527332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.527793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.558653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] MFA Rules not processed for user `4cf28eec72a8493d8ae1117fc1fd6402`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:31.560041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:31.649982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1195/2380] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:51:31.689250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.691410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:31.704056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:31.779423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46756e-e4ea-442b-9330-157e4c2d81b7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.788010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2f2ae-18d4-42f7-9c4d-407952582f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.788765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f2ae-18d4-42f7-9c4d-407952582f65 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.789061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f2ae-18d4-42f7-9c4d-407952582f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.789437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f2ae-18d4-42f7-9c4d-407952582f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.800000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2f2ae-18d4-42f7-9c4d-407952582f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.801704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2f2ae-18d4-42f7-9c4d-407952582f65 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.815905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1186/2381] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:31.832463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:31.904280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b44cce-0734-4ff2-a39b-896bfac06274 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:31.911476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:31.912964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:31.913636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:31.914005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] PATH_INFO: `/v3/users/4cf28eec72a8493d8ae1117fc1fd6402` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:31.915774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf28eec72a8493d8ae1117fc1fd6402)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:31.917734 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:31.939838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:31.989573 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf28eec72a8493d8ae1117fc1fd6402'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.003218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf28eec72a8493d8ae1117fc1fd6402'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.003964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf28eec72a8493d8ae1117fc1fd6402'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.004574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf28eec72a8493d8ae1117fc1fd6402'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.011663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf28eec72a8493d8ae1117fc1fd6402'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.030453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1196/2382] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:31 2022] DELETE /identity/v3/users/4cf28eec72a8493d8ae1117fc1fd6402 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:32.035290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:32.035586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:32.035906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:32.056191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:32.057562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:32.127318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1187/2383] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:32.137048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:32.138613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:32.206311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6a07-c27a-4d8d-8d4a-9b39fb364508 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:32.210088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d829-d071-451c-b1c9-f5cd9ed5d74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:32.210855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d829-d071-451c-b1c9-f5cd9ed5d74d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:32.211138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d829-d071-451c-b1c9-f5cd9ed5d74d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:32.211420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d829-d071-451c-b1c9-f5cd9ed5d74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:32.226130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d829-d071-451c-b1c9-f5cd9ed5d74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:32.227761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d829-d071-451c-b1c9-f5cd9ed5d74d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:32.239184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1197/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:32.646590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:32.648140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:32.668230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f1d5b-af87-4ec8-babf-a2b52dd2c9b7 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:32.680765 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:32.686552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:32.687542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:32.687935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] PATH_INFO: `/v3/projects/60993b299e4f4545aa3a577163bf5a7f` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:32.689480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60993b299e4f4545aa3a577163bf5a7f)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:32.691720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:32.745971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60993b299e4f4545aa3a577163bf5a7f', 'request_id': 'req-1cfe0669-f090-4031-ba6e-124b0da755a0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.758914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60993b299e4f4545aa3a577163bf5a7f', 'request_id': 'req-1cfe0669-f090-4031-ba6e-124b0da755a0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.766599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60993b299e4f4545aa3a577163bf5a7f', 'request_id': 'req-1cfe0669-f090-4031-ba6e-124b0da755a0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.778982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] The token cache is being invalidate because project 60993b299e4f4545aa3a577163bf5a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:32.779331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.780159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cfe0669-f090-4031-ba6e-124b0da755a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:32.781886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1188/2385] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:32 2022] DELETE /identity/v3/projects/60993b299e4f4545aa3a577163bf5a7f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:32.787512 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:32.787810 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:32.788096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:32.807259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:32.808578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:32.891291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1198/2386] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:32.893442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:32.893796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:32.894091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:32.927583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:32.928870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:32.944378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1189/2387] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:32.946271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:32.960520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6dab-8eec-4a9c-a2f2-3fef8e990d2d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:32.966490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:32.967596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:32.968709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:32.969321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:32.970250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:51:32.970760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:32.973280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:32.987492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1199/2388] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:51:32.992073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.006077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3380-68cd-48cb-8435-787e1e314832 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.012921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.013631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.013930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.014295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.015707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.017696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.047692 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1190/2389] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:32 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:51:33.052431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.064579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc22b8-432a-4143-a99f-9bed3f62defe admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.086696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:33.131695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.132656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.132952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.133238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.134041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.136630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.158953 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1200/2390] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:33 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:33.163141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.175093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92fa8-3ba9-465d-a9db-2ba25113ce77 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.180159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.180948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.181300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.181650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.182500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.184386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.185997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:33.199865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1191/2391] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:33.203144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.218803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b05a8-98dd-4204-bfa4-ac9c53a5ecd4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.223914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb9f11-3588-4b45-b1d5-eea8f39f0bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.224584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb9f11-3588-4b45-b1d5-eea8f39f0bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.224948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb9f11-3588-4b45-b1d5-eea8f39f0bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.225280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb9f11-3588-4b45-b1d5-eea8f39f0bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.226080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb9f11-3588-4b45-b1d5-eea8f39f0bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.228378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb9f11-3588-4b45-b1d5-eea8f39f0bc6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.243088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1201/2392] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:33.247057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.258608 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6e49-c743-4f60-89df-246932fc0655 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.266453 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.267372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.267663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.267945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] PATH_INFO: `/v3/projects/d2ba38be83e942fc8b2acd03f0b56772/users/ae2c39fd801f459dbb82e404b8396d20/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.289783 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ba38be83e942fc8b2acd03f0b56772, user_id=ae2c39fd801f459dbb82e404b8396d20, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.294493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.314070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1192/2393] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:33 2022] PUT /identity/v3/projects/d2ba38be83e942fc8b2acd03f0b56772/users/ae2c39fd801f459dbb82e404b8396d20/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:33.324655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.324991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.325253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.355200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] MFA Rules not processed for user `ae2c39fd801f459dbb82e404b8396d20`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:33.356568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:33.431797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1202/2394] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:51:33.436840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.511722 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818d711-d59f-4e60-afb7-29e5cd1e7444 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.517705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.518451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.518746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.519029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.519746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.521685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.570191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1193/2395] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:33 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:33.571321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.583411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3265fe-1924-4a16-a451-557722fd9cd8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.662903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.663799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.664280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.664648 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.666142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.668449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.700339 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1203/2396] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:33 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:51:33.704371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.721799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14093a76-044f-42ed-90fd-6fe7489cefa9 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.732494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.733344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.733811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.734156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.735059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.737490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.753487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1194/2397] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:33.754672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.769617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd139-4f87-49bf-8f8b-0481a192dc25 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.775235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.776270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.776640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.776994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] PATH_INFO: `/v3/projects/426db6a192f54267bd0282a496750535/users/4baefdeed0fa464884587737667bd09c/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.798421 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426db6a192f54267bd0282a496750535, user_id=4baefdeed0fa464884587737667bd09c, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.802059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.817156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:33.826448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1204/2398] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:33 2022] PUT /identity/v3/projects/426db6a192f54267bd0282a496750535/users/4baefdeed0fa464884587737667bd09c/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:51:33.829195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.845220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb32e44-e13a-4d11-ba73-8766f828d4c3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.927548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58661792-77f0-442b-9bb9-4b7c56df1ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.928609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661792-77f0-442b-9bb9-4b7c56df1ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.928976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661792-77f0-442b-9bb9-4b7c56df1ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.929378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661792-77f0-442b-9bb9-4b7c56df1ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.930193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58661792-77f0-442b-9bb9-4b7c56df1ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.931922 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58661792-77f0-442b-9bb9-4b7c56df1ca8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.949266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1195/2399] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:33.954154 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:33.965522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95c54-cc32-401d-b7d2-04d5bab39af8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:33.972454 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:33.973438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:33.973735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:33.974018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] PATH_INFO: `/v3/projects/426db6a192f54267bd0282a496750535/users/4baefdeed0fa464884587737667bd09c/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:33.976134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426db6a192f54267bd0282a496750535, user_id=4baefdeed0fa464884587737667bd09c, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:33.978857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:33.993240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1205/2400] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:33 2022] PUT /identity/v3/projects/426db6a192f54267bd0282a496750535/users/4baefdeed0fa464884587737667bd09c/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:51:34.004085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:34.004381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:34.004672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:34.034505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] MFA Rules not processed for user `4baefdeed0fa464884587737667bd09c`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:34.035653 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:34.074675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:34.136062 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1196/2401] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:34.149072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:34.151857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:34.245712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad885c-4e4b-49e9-b73e-d6a4632c6220 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:34.253743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d510560-f96f-4a6c-a45b-fbc69f321898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:34.254458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510560-f96f-4a6c-a45b-fbc69f321898 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:34.254746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510560-f96f-4a6c-a45b-fbc69f321898 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:34.255022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510560-f96f-4a6c-a45b-fbc69f321898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:34.327892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d510560-f96f-4a6c-a45b-fbc69f321898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:34.329641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d510560-f96f-4a6c-a45b-fbc69f321898 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:34.340283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1206/2402] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:37.007071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:37.070248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac93e96-ad99-478d-9029-299cc63fb6b1 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:37.074899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:37.075768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:37.076054 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:37.076333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] PATH_INFO: `/v3/users/ae2c39fd801f459dbb82e404b8396d20` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:37.077578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2c39fd801f459dbb82e404b8396d20)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:37.079762 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:37.132095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2c39fd801f459dbb82e404b8396d20'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.132740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2c39fd801f459dbb82e404b8396d20'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.139441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2c39fd801f459dbb82e404b8396d20'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.140574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2c39fd801f459dbb82e404b8396d20'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.148580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2c39fd801f459dbb82e404b8396d20'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.166141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1197/2403] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:37 2022] DELETE /identity/v3/users/ae2c39fd801f459dbb82e404b8396d20 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:37.170700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:37.171233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:37.171350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:37.188525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:37.189740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:37.249389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1207/2404] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:37.259547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:37.260955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:37.314474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:37.320883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e715-3f0c-4204-8a0b-28009b9a5e19 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:37.325808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:37.326737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:37.327034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:37.327311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:37.336798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:37.338237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:37.348785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1198/2405] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:51:37.626010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:37.627492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:37.640125 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b2fba-d429-474b-8ce3-a04c026391bc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:37.645761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:37.646741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:37.647176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:37.647426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] PATH_INFO: `/v3/projects/d2ba38be83e942fc8b2acd03f0b56772` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:37.648725 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ba38be83e942fc8b2acd03f0b56772)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:37.650984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:37.700634 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:37.714078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ba38be83e942fc8b2acd03f0b56772', 'request_id': 'req-31983b0a-a13f-481c-9532-c9fc84685a8c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.720681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ba38be83e942fc8b2acd03f0b56772', 'request_id': 'req-31983b0a-a13f-481c-9532-c9fc84685a8c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.727202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ba38be83e942fc8b2acd03f0b56772', 'request_id': 'req-31983b0a-a13f-481c-9532-c9fc84685a8c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.741468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] The token cache is being invalidate because project d2ba38be83e942fc8b2acd03f0b56772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:37.741769 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.742439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.744016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1208/2406] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:37 2022] DELETE /identity/v3/projects/d2ba38be83e942fc8b2acd03f0b56772 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:37.748208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:37.758304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0e4d-8919-4e20-8373-83e44c91b128 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:37.817622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:37.818522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:37.818804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:37.819082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] PATH_INFO: `/v3/users/4baefdeed0fa464884587737667bd09c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:37.820253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4baefdeed0fa464884587737667bd09c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:37.822190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:37.866459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baefdeed0fa464884587737667bd09c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.867108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baefdeed0fa464884587737667bd09c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.873920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baefdeed0fa464884587737667bd09c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.875315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baefdeed0fa464884587737667bd09c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.882779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a803c5e3-d97e-4717-a989-e0c74e6b7cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baefdeed0fa464884587737667bd09c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:37.899973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1199/2407] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:37 2022] DELETE /identity/v3/users/4baefdeed0fa464884587737667bd09c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:51:38.176011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.177656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:38.191383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31983b0a-a13f-481c-9532-c9fc84685a8c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.251429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.252289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.252579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.252872 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] PATH_INFO: `/v3/projects/426db6a192f54267bd0282a496750535` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.254064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=426db6a192f54267bd0282a496750535)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.256026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.302102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426db6a192f54267bd0282a496750535', 'request_id': 'req-37fece98-7274-4e71-9ce9-a761891058eb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:38.307387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426db6a192f54267bd0282a496750535', 'request_id': 'req-37fece98-7274-4e71-9ce9-a761891058eb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:38.313479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426db6a192f54267bd0282a496750535', 'request_id': 'req-37fece98-7274-4e71-9ce9-a761891058eb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:38.324958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] The token cache is being invalidate because project 426db6a192f54267bd0282a496750535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:38.325242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:38.325860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-37fece98-7274-4e71-9ce9-a761891058eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:38.327468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1209/2408] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:38 2022] DELETE /identity/v3/projects/426db6a192f54267bd0282a496750535 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:38.332610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.333105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.333217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.352172 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:38.353382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:38.414572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1200/2409] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:51:38.424405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.424706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.424997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.443931 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:38.445160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:38.453858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1210/2410] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:38.458248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.467799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee7f18-f335-4858-a373-90072cc9403a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.472705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.473400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.473687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.473972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.474735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:51:38.475045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.476638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.479668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:38.491586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1201/2411] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:51:38.503891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.515068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899632c3-06fb-4c4a-88ce-95fc9d826a11 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.521706 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.522407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.522704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.522985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.523683 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.525801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.560232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1211/2412] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:38 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:38.565158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.575170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf24d-6f8f-42bb-8117-f433c9e15037 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.632535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.633201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.633487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.633767 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.634480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.636399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.656623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1202/2413] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:38 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:38.660776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.672024 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409b19-7f5f-42d6-8993-c92852752e5c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.676858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.677533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.677821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.678134 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.678921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.680532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.692990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1212/2414] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:51:38.697436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.707503 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eb41f-0859-4fe9-a248-31cf5a3c19aa admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.712167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc8401-b8ed-417b-9862-b39585f153b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.712825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc8401-b8ed-417b-9862-b39585f153b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.713114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc8401-b8ed-417b-9862-b39585f153b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.713398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc8401-b8ed-417b-9862-b39585f153b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.714126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc8401-b8ed-417b-9862-b39585f153b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.715780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc8401-b8ed-417b-9862-b39585f153b2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.725804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1203/2415] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:38.729877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.740356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5003f9-c739-42ad-9bfa-51a79876ad91 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.745033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.745908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.746197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.746524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] PATH_INFO: `/v3/projects/1ea91ebc18454c9d941da83f82133c1a/users/c43d9496f1f440c3a132e4daa6abf385/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.758046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:38.762466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea91ebc18454c9d941da83f82133c1a, user_id=c43d9496f1f440c3a132e4daa6abf385, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.765612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.778490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1213/2416] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:38 2022] PUT /identity/v3/projects/1ea91ebc18454c9d941da83f82133c1a/users/c43d9496f1f440c3a132e4daa6abf385/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:38.788499 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.788879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.789194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.817225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] MFA Rules not processed for user `c43d9496f1f440c3a132e4daa6abf385`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:38.818574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:38.887862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1204/2417] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:38.899168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:38.900930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:38.960890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd56b-71ad-4af6-8e5f-878ff4dfe8e3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:38.964604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e162f-bf20-4f41-9841-b1a0722bd7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:38.965251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e162f-bf20-4f41-9841-b1a0722bd7ec service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:38.965535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e162f-bf20-4f41-9841-b1a0722bd7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:38.965817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e162f-bf20-4f41-9841-b1a0722bd7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:38.975539 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e162f-bf20-4f41-9841-b1a0722bd7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:38.976969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e162f-bf20-4f41-9841-b1a0722bd7ec service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:38.987274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1214/2418] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:47.126001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:47.127553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:47.195690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:47.202891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a161-696e-423c-8825-440df3cc78d4 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:47.208865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:47.209516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:47.209806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:47.210101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:47.211948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:47.271367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:47.272970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:47.282546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1205/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:48.990754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:49.950899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:49.951223 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:49.951511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:49.970723 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:49.971928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:50.028611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1215/2420] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 19 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:50.043055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:50.044548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:50.117097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1c7df-cf54-4007-8cab-99a3ba0375db service nova] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:50.122077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cc20b-107b-4955-a8a2-af2b9a693c6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:50.122775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cc20b-107b-4955-a8a2-af2b9a693c6c service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:50.123169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cc20b-107b-4955-a8a2-af2b9a693c6c service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:50.123456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cc20b-107b-4955-a8a2-af2b9a693c6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:50.134726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cc20b-107b-4955-a8a2-af2b9a693c6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:50.134726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cc20b-107b-4955-a8a2-af2b9a693c6c service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:50.143325 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1206/2421] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:51:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:58.617978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:58.679487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d95c93-89cc-4667-9333-e1593c84e606 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:58.684239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:58.685120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:58.685411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:58.685689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] PATH_INFO: `/v3/users/c43d9496f1f440c3a132e4daa6abf385` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:58.686914 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43d9496f1f440c3a132e4daa6abf385)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:58.688854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:58.736404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43d9496f1f440c3a132e4daa6abf385'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:58.748458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43d9496f1f440c3a132e4daa6abf385'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:58.749143 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43d9496f1f440c3a132e4daa6abf385'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:58.749786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43d9496f1f440c3a132e4daa6abf385'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:58.756572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43d9496f1f440c3a132e4daa6abf385'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:58.770946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1216/2422] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:51:58 2022] DELETE /identity/v3/users/c43d9496f1f440c3a132e4daa6abf385 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:58.775600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:58.776063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:58.776476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:58.795955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:58.797158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:58.856109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1207/2423] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:51:58.866459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:58.867864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:58.896164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:58.929276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323ebc9-52e9-4a12-ad6f-1df66419eb55 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:58.932940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfec38-5bed-4fa1-b884-81d35c83d9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:58.933587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfec38-5bed-4fa1-b884-81d35c83d9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:58.933879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfec38-5bed-4fa1-b884-81d35c83d9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:58.934159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfec38-5bed-4fa1-b884-81d35c83d9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:58.943943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfec38-5bed-4fa1-b884-81d35c83d9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:58.945379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfec38-5bed-4fa1-b884-81d35c83d9f6 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:58.954869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1217/2424] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:59.225899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.227455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:59.240005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56712441-a1f5-4e5b-bc19-c54753119429 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.244690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.245549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.245836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.246118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] PATH_INFO: `/v3/projects/1ea91ebc18454c9d941da83f82133c1a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.248206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea91ebc18454c9d941da83f82133c1a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.250297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.283951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:59.301977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea91ebc18454c9d941da83f82133c1a', 'request_id': 'req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:59.308920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea91ebc18454c9d941da83f82133c1a', 'request_id': 'req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:59.315500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea91ebc18454c9d941da83f82133c1a', 'request_id': 'req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:59.326312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] The token cache is being invalidate because project 1ea91ebc18454c9d941da83f82133c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:51:59.326634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:59.327279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8dd5d699-66ec-47b5-8c88-a8e22bda0b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:51:59.328833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1208/2425] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:51:59 2022] DELETE /identity/v3/projects/1ea91ebc18454c9d941da83f82133c1a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:59.333768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.334063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.334403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.352710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:59.353919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:59.418902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1218/2426] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:59.427663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.427956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.428240 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.446432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:59.447627 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:59.456084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1209/2427] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:59.460208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.469766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494e9ea-8232-414c-9a58-a7f8078619cc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.474939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.475584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.475867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.476142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.476862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:51:59.477166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.478784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.489920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1219/2428] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:51:59.494110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.503632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bd7e3-3301-4b0a-b1bf-1752052ddbec None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.508295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.508943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.509234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.509516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.510242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.512185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.537664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1210/2429] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:51:59 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:59.541961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.552547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91fbb2-5824-451d-ae8b-12c37e9f9d0c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.609746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.610457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.611315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.611782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.612487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.614473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.633899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1220/2430] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:51:59 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:51:59.637979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.648463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613355b-4ab5-49a9-b4f0-02ca4501f3b2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.653036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.653688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.653971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.654246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.655018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.656602 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.667259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1211/2431] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:59.671133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.681938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1431697-2dd0-453a-a3a5-ee28522b76ee admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.686607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dcb82-e64e-4bbe-a146-3d13500fdcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.687266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dcb82-e64e-4bbe-a146-3d13500fdcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.687559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dcb82-e64e-4bbe-a146-3d13500fdcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.687838 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dcb82-e64e-4bbe-a146-3d13500fdcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.688560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dcb82-e64e-4bbe-a146-3d13500fdcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.690818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dcb82-e64e-4bbe-a146-3d13500fdcb0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.700991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1221/2432] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:51:59.705519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.715632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf66ab-da26-4064-9b67-3c7507a4f07d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.720259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.721221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.721538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.721860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] PATH_INFO: `/v3/projects/c1e4855e61b549deac9b64f14cccd839/users/04d1069057604ffb9cebbdfbf9a3de12/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.736998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e4855e61b549deac9b64f14cccd839, user_id=04d1069057604ffb9cebbdfbf9a3de12, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.739880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.753962 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1212/2433] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:51:59 2022] PUT /identity/v3/projects/c1e4855e61b549deac9b64f14cccd839/users/04d1069057604ffb9cebbdfbf9a3de12/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:51:59.822732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.822926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.823122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.850983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] MFA Rules not processed for user `04d1069057604ffb9cebbdfbf9a3de12`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:59.852206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:59.872408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:59.918132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1222/2434] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:59.929855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.931646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:59.987127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e962-fdac-48df-aacd-339b84fb3b26 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.991150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e5f2d-9a7c-4b37-b7cb-8ba70af58dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.991791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5f2d-9a7c-4b37-b7cb-8ba70af58dbe service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.992068 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5f2d-9a7c-4b37-b7cb-8ba70af58dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.992343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5f2d-9a7c-4b37-b7cb-8ba70af58dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:00.000815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e5f2d-9a7c-4b37-b7cb-8ba70af58dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:00.002260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e5f2d-9a7c-4b37-b7cb-8ba70af58dbe service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:00.011384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1213/2435] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:02.989128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.049753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f9a3-64a8-45f1-96b9-7479746a6a6b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.054206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.055100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.055383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.055657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] PATH_INFO: `/v3/users/04d1069057604ffb9cebbdfbf9a3de12` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.056828 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d1069057604ffb9cebbdfbf9a3de12)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.058774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:03.104150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d1069057604ffb9cebbdfbf9a3de12'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.115596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d1069057604ffb9cebbdfbf9a3de12'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.116262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d1069057604ffb9cebbdfbf9a3de12'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.116864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d1069057604ffb9cebbdfbf9a3de12'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.123807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d1069057604ffb9cebbdfbf9a3de12'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.136411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1223/2436] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:02 2022] DELETE /identity/v3/users/04d1069057604ffb9cebbdfbf9a3de12 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:03.141130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.141605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.141713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.159539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:03.160740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:03.207560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:03.221159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1214/2437] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:03.230775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.232251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:03.278901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:03.291907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a476b-63ac-47bd-ad28-a682d65882d3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.295716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652e814-53ef-4c48-aaf8-4b70d22b0ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.296359 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e814-53ef-4c48-aaf8-4b70d22b0ffa service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.296647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e814-53ef-4c48-aaf8-4b70d22b0ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.296927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e814-53ef-4c48-aaf8-4b70d22b0ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.306780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652e814-53ef-4c48-aaf8-4b70d22b0ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.308217 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652e814-53ef-4c48-aaf8-4b70d22b0ffa service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:03.318380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1224/2438] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:03.589659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.591090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:03.614629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdefdd-5295-412b-b705-8e05a678e954 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.621340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.622324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.622837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.622986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] PATH_INFO: `/v3/projects/c1e4855e61b549deac9b64f14cccd839` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.624301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e4855e61b549deac9b64f14cccd839)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.626206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:03.674959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e4855e61b549deac9b64f14cccd839', 'request_id': 'req-2162e923-4bd2-476f-9982-1b38e6c25872'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.683850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e4855e61b549deac9b64f14cccd839', 'request_id': 'req-2162e923-4bd2-476f-9982-1b38e6c25872'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.690746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e4855e61b549deac9b64f14cccd839', 'request_id': 'req-2162e923-4bd2-476f-9982-1b38e6c25872'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.700908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] The token cache is being invalidate because project c1e4855e61b549deac9b64f14cccd839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:03.701196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.701831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2162e923-4bd2-476f-9982-1b38e6c25872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:03.703388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1215/2439] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:03 2022] DELETE /identity/v3/projects/c1e4855e61b549deac9b64f14cccd839 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:03.708633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.708919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.709196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.727862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:03.729012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:03.787849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1225/2440] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:03.795651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.796047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.796399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.816059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:03.817380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:03.825288 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1216/2441] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:03.829420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.839613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2289e-d5bb-4352-843a-f54ca866f7ca None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.844222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.844890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.845173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.845451 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.846919 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:03.847225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.848808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:03.860127 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1226/2442] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:03.865154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.874341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9d7a2-2478-4f85-b97e-ae79180097b2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.879118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.879771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.880060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.880343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.881048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.882998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:03.908972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1217/2443] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:03 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:52:03.913248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.923614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed611b1f-e466-4429-a2da-de7d99d5fab8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.978098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.978698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.978986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.979265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.979943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.981856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:04.003771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1227/2444] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:03 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:04.008059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:04.019038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443751f-d118-4888-b284-6cfa2518148d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:04.023605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:04.024248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:04.024532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:04.024812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:04.025568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:04.027197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:04.038124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1218/2445] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:04.042575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:04.052824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac211b-c5d1-4c47-894e-5d3657a75661 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:04.057546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb033f-e7ed-47fe-81c4-829ee69d9c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:04.058205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb033f-e7ed-47fe-81c4-829ee69d9c32 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:04.058537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb033f-e7ed-47fe-81c4-829ee69d9c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:04.058825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb033f-e7ed-47fe-81c4-829ee69d9c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:04.059586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb033f-e7ed-47fe-81c4-829ee69d9c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:04.061186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb033f-e7ed-47fe-81c4-829ee69d9c32 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:04.071081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1228/2446] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:04.080981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:04.090997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f1373-89e1-4d63-8193-3b1216734680 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:04.097013 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:04.097977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:04.098322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:04.098650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] PATH_INFO: `/v3/projects/c3cb17b8a48548c2bada4cc4fc946181/users/a51a00b57ea94d839a9bcdd650bd11a7/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:04.113292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cb17b8a48548c2bada4cc4fc946181, user_id=a51a00b57ea94d839a9bcdd650bd11a7, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:04.115985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:04.128275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1219/2447] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:04 2022] PUT /identity/v3/projects/c3cb17b8a48548c2bada4cc4fc946181/users/a51a00b57ea94d839a9bcdd650bd11a7/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:04.139893 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:04.140198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:04.140488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:04.167580 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] MFA Rules not processed for user `a51a00b57ea94d839a9bcdd650bd11a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:04.168802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:04.208578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:04.235981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1229/2448] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:04.247726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:04.249535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:04.309584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6944ba6-13b7-43d1-a7c5-f83d3d69f1bb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:04.313198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe33b8d-5c99-4e05-9c2c-313692017edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:04.313842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe33b8d-5c99-4e05-9c2c-313692017edf service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:04.314123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe33b8d-5c99-4e05-9c2c-313692017edf service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:04.315111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe33b8d-5c99-4e05-9c2c-313692017edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:04.323914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe33b8d-5c99-4e05-9c2c-313692017edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:04.325342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe33b8d-5c99-4e05-9c2c-313692017edf service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:04.334971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1220/2449] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:06.871353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:06.933766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0423-d91d-4a10-bf93-95d64784167b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:06.938426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:06.939453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:06.939718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:06.939927 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] PATH_INFO: `/v3/users/a51a00b57ea94d839a9bcdd650bd11a7` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:06.941184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51a00b57ea94d839a9bcdd650bd11a7)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:06.943166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:06.988821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51a00b57ea94d839a9bcdd650bd11a7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.000640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51a00b57ea94d839a9bcdd650bd11a7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.001419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51a00b57ea94d839a9bcdd650bd11a7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.002100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51a00b57ea94d839a9bcdd650bd11a7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.009581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51a00b57ea94d839a9bcdd650bd11a7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.024004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1230/2450] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:06 2022] DELETE /identity/v3/users/a51a00b57ea94d839a9bcdd650bd11a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:07.028159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:07.028671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:07.028760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:07.047445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:07.048718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:07.058096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:07.109086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1221/2451] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:07.119619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:07.121041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:07.179998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea38dd-1e84-4f8b-9630-3fafe9f772a2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:07.183709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:07.184352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:07.184642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:07.184923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:07.194979 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:07.196350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:07.207425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1231/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:07.506543 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:07.508276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:07.521680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea020-dc7c-4bf6-ab83-fc5b54f778ff None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:07.527390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:07.528373 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:07.528709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:07.528923 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] PATH_INFO: `/v3/projects/c3cb17b8a48548c2bada4cc4fc946181` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:07.530142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cb17b8a48548c2bada4cc4fc946181)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:07.532884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:07.588899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cb17b8a48548c2bada4cc4fc946181', 'request_id': 'req-e69f02c5-843e-4234-bb0d-c2a7f7074787'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.597651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cb17b8a48548c2bada4cc4fc946181', 'request_id': 'req-e69f02c5-843e-4234-bb0d-c2a7f7074787'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.605354 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cb17b8a48548c2bada4cc4fc946181', 'request_id': 'req-e69f02c5-843e-4234-bb0d-c2a7f7074787'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.619111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] The token cache is being invalidate because project c3cb17b8a48548c2bada4cc4fc946181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:07.619446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.620162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:07.621730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1222/2453] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:07 2022] DELETE /identity/v3/projects/c3cb17b8a48548c2bada4cc4fc946181 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:16.983724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:16.985165 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:16.992325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:16.999013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b35d5-0f6e-4dce-b972-bf4679d018d3 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:17.048529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:17.049175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:17.049460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:17.049745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:17.052130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:17.113599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:17.115076 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:17.124591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1232/2454] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:17.613904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:20.245666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:20.247219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:20.324445 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:20.326168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:20.334534 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f02c5-843e-4234-bb0d-c2a7f7074787 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:20.340745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:20.341516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.341987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.342448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.345010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:20.351111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34ed6-abdd-4333-a0c8-7bafe3202b82 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:20.359388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:20.359897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:20.360149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.360502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.360794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] PATH_INFO: `/v3/users/d9c75043813844d79fd0764132dfe4dd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.361814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:20.362049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c75043813844d79fd0764132dfe4dd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:20.364826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:20.373999 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1223/2455] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:20.418918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c75043813844d79fd0764132dfe4dd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.434345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c75043813844d79fd0764132dfe4dd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.435097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c75043813844d79fd0764132dfe4dd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.435701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c75043813844d79fd0764132dfe4dd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.443342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ada7c4a0-9815-44ae-bbbe-7158409bb4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c75043813844d79fd0764132dfe4dd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.455858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1233/2456] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:20 2022] DELETE /identity/v3/users/d9c75043813844d79fd0764132dfe4dd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:20.628556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:20.639622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a867-2405-48b2-b7f3-c31a60c45641 service placement] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:20.698105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:20.698944 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.699237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.699521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] PATH_INFO: `/v3/projects/e11e234f713b40cd8772372c2316dd28` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.700707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11e234f713b40cd8772372c2316dd28)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:20.702710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:20.749326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11e234f713b40cd8772372c2316dd28', 'request_id': 'req-e14253e2-6cce-4e52-ab7f-cfa710678270'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.757133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11e234f713b40cd8772372c2316dd28', 'request_id': 'req-e14253e2-6cce-4e52-ab7f-cfa710678270'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.763426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11e234f713b40cd8772372c2316dd28', 'request_id': 'req-e14253e2-6cce-4e52-ab7f-cfa710678270'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.774327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] The token cache is being invalidate because project e11e234f713b40cd8772372c2316dd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:20.774644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.775301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e14253e2-6cce-4e52-ab7f-cfa710678270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:20.776831 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1224/2457] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:20 2022] DELETE /identity/v3/projects/e11e234f713b40cd8772372c2316dd28 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:20.781840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.782138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.782446 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.801403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:20.802657 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:20.821393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:20.864168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1234/2458] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:52:20.872307 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.872598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.872897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.892060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:20.893262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:20.902108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1225/2459] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:20.906185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:20.916498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50903ac-65b6-4857-892c-cdef81eb2e5f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:20.921091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:20.921760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.922031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.922315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.923088 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:20.923403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:20.925172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:20.936636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1235/2460] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:20.941335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:20.950986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee772-3b37-4fb1-a5f6-273ab39e4ed0 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:20.957020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:20.957945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:20.958237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:20.958554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:20.959311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:20.961267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:20.972640 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:20.991386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1226/2461] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:20 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:20.995414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:21.005450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e3389-1ddc-44e4-ab00-3998250f173d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:21.061726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:21.062416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:21.062709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:21.062990 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:21.063692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:21.066192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:21.085655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1236/2462] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:20 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:21.089897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:21.100407 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a6ccd-8dd5-447f-985e-304c84be87e4 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:21.104956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:21.105605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:21.105890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:21.106167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:21.106935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:21.108513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:21.119535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1227/2463] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:21.123466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:21.133550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73ad1-6285-4652-a99c-50887f331cea admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:21.138180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a733f-58b1-4ac5-b8a0-b7a975097a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:21.138984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a733f-58b1-4ac5-b8a0-b7a975097a96 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:21.139313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a733f-58b1-4ac5-b8a0-b7a975097a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:21.139673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a733f-58b1-4ac5-b8a0-b7a975097a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:21.140475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a733f-58b1-4ac5-b8a0-b7a975097a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:21.142072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a733f-58b1-4ac5-b8a0-b7a975097a96 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:21.153028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1237/2464] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:21.156896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:21.167332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c1017-8f84-4d6c-8cf3-72159bddf66c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:21.172034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:21.172920 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:21.173208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:21.173492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] PATH_INFO: `/v3/projects/104e846fd50c4aa18b43097f86270d8c/users/07738eb01d254841ac0c8ac011e45a10/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:21.189988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104e846fd50c4aa18b43097f86270d8c, user_id=07738eb01d254841ac0c8ac011e45a10, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:21.194047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:21.207488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1228/2465] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:21 2022] PUT /identity/v3/projects/104e846fd50c4aa18b43097f86270d8c/users/07738eb01d254841ac0c8ac011e45a10/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:21.217360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:21.217660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:21.218032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:21.245336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] MFA Rules not processed for user `07738eb01d254841ac0c8ac011e45a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:21.246749 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:21.311385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1238/2466] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:21.323184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:21.324896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:21.399827 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd170c-b7a1-4b15-a8de-ebe4499f61e1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:21.405410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d195-be87-409e-8fcd-e2a0eb538f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:21.406043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d195-be87-409e-8fcd-e2a0eb538f18 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:21.406331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d195-be87-409e-8fcd-e2a0eb538f18 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:21.406644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d195-be87-409e-8fcd-e2a0eb538f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:21.415189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5d195-be87-409e-8fcd-e2a0eb538f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:21.417029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5d195-be87-409e-8fcd-e2a0eb538f18 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:21.425723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1229/2467] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:28.902823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:28.931302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:28.998467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7faa15-ad43-4453-9a68-e50da24186ea None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:29.006996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:29.008813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.009329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.009819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] PATH_INFO: `/v3/users/07738eb01d254841ac0c8ac011e45a10` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.013703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07738eb01d254841ac0c8ac011e45a10)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:29.018188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:29.085213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07738eb01d254841ac0c8ac011e45a10'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.102766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07738eb01d254841ac0c8ac011e45a10'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.103781 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07738eb01d254841ac0c8ac011e45a10'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.104355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07738eb01d254841ac0c8ac011e45a10'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.114162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07738eb01d254841ac0c8ac011e45a10'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.132635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1239/2468] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:28 2022] DELETE /identity/v3/users/07738eb01d254841ac0c8ac011e45a10 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:29.137278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.137755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.137851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.158055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:29.159858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:29.227308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1230/2469] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:29.239964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:29.241432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:29.308690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ce26-e0c5-48f5-a69a-d155dcafa94f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:29.312397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e0864-459a-41d8-bff4-361c3b5143db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:29.313039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0864-459a-41d8-bff4-361c3b5143db service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.313324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0864-459a-41d8-bff4-361c3b5143db service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.313596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0864-459a-41d8-bff4-361c3b5143db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.323623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e0864-459a-41d8-bff4-361c3b5143db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:29.325071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e0864-459a-41d8-bff4-361c3b5143db service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:29.335544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1240/2470] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:29.622628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:29.624106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:29.636672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d4ee3-04a0-4eec-9ccc-07e408a4cc25 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:29.641541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:29.642717 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.643047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.643344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] PATH_INFO: `/v3/projects/104e846fd50c4aa18b43097f86270d8c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.645421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104e846fd50c4aa18b43097f86270d8c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:29.647415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:29.703036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:29.716090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104e846fd50c4aa18b43097f86270d8c', 'request_id': 'req-18331c88-20ff-426d-b38c-96d84e9e7638'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.730491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104e846fd50c4aa18b43097f86270d8c', 'request_id': 'req-18331c88-20ff-426d-b38c-96d84e9e7638'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.739712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104e846fd50c4aa18b43097f86270d8c', 'request_id': 'req-18331c88-20ff-426d-b38c-96d84e9e7638'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.754554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] The token cache is being invalidate because project 104e846fd50c4aa18b43097f86270d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:29.754935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.755758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-18331c88-20ff-426d-b38c-96d84e9e7638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:29.757696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1231/2471] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:29 2022] DELETE /identity/v3/projects/104e846fd50c4aa18b43097f86270d8c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:29.762615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.762980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.763358 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.785264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:29.786537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:29.828293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:29.861552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1241/2472] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:52:29.870525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.870896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.871187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.892053 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:29.893329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:29.902238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1232/2473] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:29.906472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:29.916983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab046f-3769-464a-a894-4b67e80c1e79 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:29.921578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:29.922248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.922551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.922829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.923562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:29.923859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:29.925710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:29.941492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1242/2474] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:29.942956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:29.951992 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74973-18cd-48c5-94b3-5a57ddab7c89 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:29.957419 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:29.958088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:29.958397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:29.958681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:29.959371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:29.961309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:29.992143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1233/2475] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:29 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:29.993285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.003356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32b50d-8391-4a2e-ba73-368e8b38c79d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.072897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.073814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.074331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.074704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.075412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.077362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.098784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1243/2476] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:29 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:30.102906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.114457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda3224-ffb4-44bd-a3dd-70be1297b2e5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.119135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.119807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.120132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.120418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.121150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.122815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.134275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1234/2477] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:30.138335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.148637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396270c-64f7-41ed-864e-9f0e5e4d014c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.153466 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dfd78-7230-4800-a940-e34a684d1d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.154212 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dfd78-7230-4800-a940-e34a684d1d6f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.154530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dfd78-7230-4800-a940-e34a684d1d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.154812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dfd78-7230-4800-a940-e34a684d1d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.155540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dfd78-7230-4800-a940-e34a684d1d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.157133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dfd78-7230-4800-a940-e34a684d1d6f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.167825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1244/2478] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:30.171955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.183338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8245a2-a9c9-4a69-8eb4-5db3a23ded63 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.188813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.189705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.189998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.190282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] PATH_INFO: `/v3/projects/b7f0ad7c04714e62be42fc1ded635420/users/429fc8cb06f4442abd93eac8354b35c9/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.206521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f0ad7c04714e62be42fc1ded635420, user_id=429fc8cb06f4442abd93eac8354b35c9, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.209245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.222939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1235/2479] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:30 2022] PUT /identity/v3/projects/b7f0ad7c04714e62be42fc1ded635420/users/429fc8cb06f4442abd93eac8354b35c9/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:30.233157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.233457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.234000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.262650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] MFA Rules not processed for user `429fc8cb06f4442abd93eac8354b35c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:30.263882 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:30.354806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1245/2480] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:30.359226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.445016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aac9c-c527-4bcb-b9cd-af930e10371e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.449687 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.450350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.450706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.450993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.451700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.453625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.485943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1236/2481] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:30 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:30.487440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.498970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c642b71-75e3-41f4-8b32-75d695e327ad None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.535667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:30.580510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.581267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.581550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.581843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.582635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.584610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.608498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1246/2482] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:30 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:30.610137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.622950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe61bb4-59ac-4bf2-ae0e-9c2b843e9c77 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.627957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.628964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.629392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.629529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.630349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.631914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.644734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1237/2483] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:52:30.649271 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.660419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be25338-538e-4a35-b84f-404e9f959b3b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.665009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.665904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.666474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.666757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] PATH_INFO: `/v3/projects/8d9f6b714fc94cda8af05e4f93fa8573/users/85c391ff697c4f5aadcbbde4be0f45e4/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.691879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9f6b714fc94cda8af05e4f93fa8573, user_id=85c391ff697c4f5aadcbbde4be0f45e4, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.695037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.716319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.717325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1247/2484] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:30 2022] PUT /identity/v3/projects/8d9f6b714fc94cda8af05e4f93fa8573/users/85c391ff697c4f5aadcbbde4be0f45e4/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:30.728711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502af16-37f5-49f2-a6a8-b3a3ac8d06b8 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.768933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:30.797748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f04e-bf73-4bc5-b8df-62bf4c7e4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.798447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f04e-bf73-4bc5-b8df-62bf4c7e4c2f admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.798829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f04e-bf73-4bc5-b8df-62bf4c7e4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.799139 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f04e-bf73-4bc5-b8df-62bf4c7e4c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.800526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1f04e-bf73-4bc5-b8df-62bf4c7e4c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.802274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1f04e-bf73-4bc5-b8df-62bf4c7e4c2f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.817037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1238/2485] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:30.821782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.834710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63833bd-1cb6-49e3-ab00-aff492723694 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:30.840096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:30.841045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.841420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.842783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] PATH_INFO: `/v3/projects/8d9f6b714fc94cda8af05e4f93fa8573/users/85c391ff697c4f5aadcbbde4be0f45e4/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.845650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9f6b714fc94cda8af05e4f93fa8573, user_id=85c391ff697c4f5aadcbbde4be0f45e4, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:30.849822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:30.861982 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1248/2486] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:30 2022] PUT /identity/v3/projects/8d9f6b714fc94cda8af05e4f93fa8573/users/85c391ff697c4f5aadcbbde4be0f45e4/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:30.872798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:30.873095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:30.873378 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:30.905278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] MFA Rules not processed for user `85c391ff697c4f5aadcbbde4be0f45e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:30.906538 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:30.982518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1239/2487] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:30.995054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:30.996799 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:31.055702 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cc0e3-6f7f-47eb-b614-1bc0c55c1254 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:31.059624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:31.060452 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:31.060735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:31.061014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:31.071324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:31.073032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:31.084263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1249/2488] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:31.173399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:31.183718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121886-4682-4bb3-a30e-b3a4352b16a0 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:31.187461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:31.188190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:31.188564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:31.188914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:31.251158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:31.251979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:31.264727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1240/2489] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:33.076325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:33.077793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:33.135948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d983720-8c6c-42ae-a8df-aa1e9da1020a service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:33.139615 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:33.140261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:33.140594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:33.140854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:33.142643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:33.189104 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:33.208983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:33.210477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:33.220377 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1250/2490] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:36.434028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:36.435636 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:36.500968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:36.506848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:36.509052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:36.520935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db7e6-51cf-4e82-85b3-d7f001689819 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:36.526044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:36.526746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:36.527036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:36.527319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:36.528970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1fe6-050c-4a0b-810c-a3295ed72636 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:36.529128 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:36.534066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:36.535074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:36.535378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:36.535663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] PATH_INFO: `/v3/users/fca86639f2d344be97cb1529dc17f62a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:36.536877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca86639f2d344be97cb1529dc17f62a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:36.539945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:36.542254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:36.544273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:36.558946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1241/2491] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:36.603617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca86639f2d344be97cb1529dc17f62a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.617224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca86639f2d344be97cb1529dc17f62a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.618052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca86639f2d344be97cb1529dc17f62a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.618743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca86639f2d344be97cb1529dc17f62a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.626201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6a1512c4-ea91-40ad-9596-4fc7c62546ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca86639f2d344be97cb1529dc17f62a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.644785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1251/2492] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:36 2022] DELETE /identity/v3/users/fca86639f2d344be97cb1529dc17f62a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:36.826804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:36.839101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac97fa-bc82-4036-882f-127541eebdfa service placement] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:36.897291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:36.898175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:36.898567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:36.898851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] PATH_INFO: `/v3/projects/171a2f5462994c8d98ffd8cbc2ce5677` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:36.900203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171a2f5462994c8d98ffd8cbc2ce5677)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:36.902158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:36.951423 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171a2f5462994c8d98ffd8cbc2ce5677', 'request_id': 'req-3b1c9269-5e63-42e1-be33-1d6791c897c2'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.959401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171a2f5462994c8d98ffd8cbc2ce5677', 'request_id': 'req-3b1c9269-5e63-42e1-be33-1d6791c897c2'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.965731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171a2f5462994c8d98ffd8cbc2ce5677', 'request_id': 'req-3b1c9269-5e63-42e1-be33-1d6791c897c2'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.976959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] The token cache is being invalidate because project 171a2f5462994c8d98ffd8cbc2ce5677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:36.977253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.977953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-3b1c9269-5e63-42e1-be33-1d6791c897c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:36.979625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1242/2493] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:36 2022] DELETE /identity/v3/projects/171a2f5462994c8d98ffd8cbc2ce5677 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:36.984642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:36.985007 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:36.985370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.004780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:37.006145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:37.198408 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1252/2494] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:37.201309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.201593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.201882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.220825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:37.223163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:37.231310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1243/2495] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:37.235587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.245548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c350-f975-43f8-8c05-97f324780787 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.250266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.250960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.251239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.251526 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.252244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:37.252549 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.254860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.266483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1253/2496] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:37.271625 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.280787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814195-3f48-4d80-9fbb-847332c71a39 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.285673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.286344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.286660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.286943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.287652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.289605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.320956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1244/2497] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:37 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:52:37.322023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.334018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41895-36aa-457f-ae55-03a00b46fde3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.379255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:37.398188 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.398907 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.399219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.399465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.400186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.402126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.425121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1254/2498] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:37 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:37.428335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.438892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820765a1-7221-4477-89c7-19f98fe18abb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.444848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.445525 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.445820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.446116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.446890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.448518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.459143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1245/2499] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:37.463297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.473775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c36db-5459-4db2-86d3-fa91326c6242 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.478412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8778-283c-47c4-b2d7-c1af6daa8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.479167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8778-283c-47c4-b2d7-c1af6daa8df7 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.479347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8778-283c-47c4-b2d7-c1af6daa8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.479626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8778-283c-47c4-b2d7-c1af6daa8df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.480444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a8778-283c-47c4-b2d7-c1af6daa8df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.482178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a8778-283c-47c4-b2d7-c1af6daa8df7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.497705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1255/2500] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:37.498876 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.509566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c243a55-3f58-4325-a5e3-c601b189c149 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.515200 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.516294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.516571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.516965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] PATH_INFO: `/v3/projects/1a557a0fec5448b7a913e52ec94ce250/users/72d8e2fc6b6640ed9590f119eaccad45/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.531972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a557a0fec5448b7a913e52ec94ce250, user_id=72d8e2fc6b6640ed9590f119eaccad45, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.535330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.548592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1246/2501] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:37 2022] PUT /identity/v3/projects/1a557a0fec5448b7a913e52ec94ce250/users/72d8e2fc6b6640ed9590f119eaccad45/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:37.554904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6514b8-ac7c-42c3-91f9-1e23b6d38db3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.555385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6514b8-ac7c-42c3-91f9-1e23b6d38db3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.555505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6514b8-ac7c-42c3-91f9-1e23b6d38db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.574473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ac6514b8-ac7c-42c3-91f9-1e23b6d38db3 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:37.575647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ac6514b8-ac7c-42c3-91f9-1e23b6d38db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:37.639754 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1256/2502] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:37.650004 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:37.651761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:37.667136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:37.719287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3975e3-0e12-40dd-b7fd-487aac7d4b19 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:37.723042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:37.723721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:37.724012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:37.724297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:37.739098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:37.740552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:37.750672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1247/2503] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:38.703244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:38.703775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:38.703775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:38.730475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] MFA Rules not processed for user `72d8e2fc6b6640ed9590f119eaccad45`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:38.731729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:38.804300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1257/2504] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:38.808764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:38.821246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a410e-3082-4f6d-821c-f0e59f5dcc83 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:38.826311 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:38.827086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:38.827592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:38.828102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:38.828901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:38.830976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:38.870495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1248/2505] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:38 2022] POST /identity/v3/projects => generated 403 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:38.871926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:38.883228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392968e-902b-4044-80e8-1b099ad87732 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:38.945319 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:38.959578 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:38.960158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:38.960443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:38.960724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:38.961420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:38.963379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:38.984532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1258/2506] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:38 2022] POST /identity/v3/users => generated 308 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:38.989390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:38.999615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87cb0b-320d-4ede-b1d7-47c6fb696658 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:39.004460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:39.005064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:39.005353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:39.005637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:39.006383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:39.008021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:39.019181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1249/2507] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:39.023414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:39.033858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cfe3-d71c-43a1-a4d4-9f33f80ecd48 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:39.039392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:39.040276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:39.040556 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:39.040829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] PATH_INFO: `/v3/projects/48d53f45bede45c6b768bedfd4499031/users/bc885308f1174e279f2c024d82d5c12b/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:39.056607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d53f45bede45c6b768bedfd4499031, user_id=bc885308f1174e279f2c024d82d5c12b, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:39.059303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:39.072524 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1259/2508] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:39 2022] PUT /identity/v3/projects/48d53f45bede45c6b768bedfd4499031/users/bc885308f1174e279f2c024d82d5c12b/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:39.076646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:39.087776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55632-3061-4cca-96af-7164d9a298cb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:39.148909 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:39.149616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:39.149906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:39.150190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:39.150990 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:39.152628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:39.165916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1250/2509] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:39.170821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:39.183354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87129a1-9d65-45f2-96bb-e58ea8abd289 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:39.188393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602844c-6412-4a7d-8d65-e5844b205c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:39.189405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602844c-6412-4a7d-8d65-e5844b205c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:39.189761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602844c-6412-4a7d-8d65-e5844b205c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:39.190700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602844c-6412-4a7d-8d65-e5844b205c20 admin admin] PATH_INFO: `/v3/projects/48d53f45bede45c6b768bedfd4499031/users/bc885308f1174e279f2c024d82d5c12b/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:39.194004 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602844c-6412-4a7d-8d65-e5844b205c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d53f45bede45c6b768bedfd4499031, user_id=bc885308f1174e279f2c024d82d5c12b, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:39.197069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602844c-6412-4a7d-8d65-e5844b205c20 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:39.216745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1260/2510] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:39 2022] PUT /identity/v3/projects/48d53f45bede45c6b768bedfd4499031/users/bc885308f1174e279f2c024d82d5c12b/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:39.267613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:39.270372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:39.353881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257c37-b2d7-4da4-b919-cd86a515faf7 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:39.392398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:39.419352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:39.420436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:39.420816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:39.421122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:39.423771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:39.496641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:39.498132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:39.510039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1251/2511] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:39.921092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:39.921669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:39.921669 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:39.951383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] MFA Rules not processed for user `bc885308f1174e279f2c024d82d5c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:39.952721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:40.033193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1261/2512] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:41.536016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:41.551500 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17341967-b49c-44c7-84e8-713fa01f54ab service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:41.556742 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:41.557628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:41.557914 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:41.558198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] PATH_INFO: `/v3/users/72d8e2fc6b6640ed9590f119eaccad45` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:41.559504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d8e2fc6b6640ed9590f119eaccad45)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:41.561435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:41.612993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d8e2fc6b6640ed9590f119eaccad45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:41.613666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d8e2fc6b6640ed9590f119eaccad45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:41.620793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d8e2fc6b6640ed9590f119eaccad45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:41.621468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d8e2fc6b6640ed9590f119eaccad45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:41.629247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d8e2fc6b6640ed9590f119eaccad45'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:41.652835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1252/2513] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:41 2022] DELETE /identity/v3/users/72d8e2fc6b6640ed9590f119eaccad45 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:41.859546 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:41.876423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051676-537e-4cd7-8c7f-4bea8974569d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:41.961850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:41.963231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:41.963611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:41.964178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] PATH_INFO: `/v3/projects/1a557a0fec5448b7a913e52ec94ce250` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:41.965939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a557a0fec5448b7a913e52ec94ce250)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:41.968699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:42.019264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:42.040424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a557a0fec5448b7a913e52ec94ce250', 'request_id': 'req-4f7ea732-c991-475c-bea4-c02e9a73b674'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.048895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a557a0fec5448b7a913e52ec94ce250', 'request_id': 'req-4f7ea732-c991-475c-bea4-c02e9a73b674'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.063770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a557a0fec5448b7a913e52ec94ce250', 'request_id': 'req-4f7ea732-c991-475c-bea4-c02e9a73b674'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.086226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] The token cache is being invalidate because project 1a557a0fec5448b7a913e52ec94ce250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:42.087449 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.088337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.091158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1262/2514] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:41 2022] DELETE /identity/v3/projects/1a557a0fec5448b7a913e52ec94ce250 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:42.095057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:42.096928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:42.117844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee615627-297f-4d8d-8086-23330015bf63 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:42.190094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:42.198823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:42.199942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:42.200301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:42.200694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] PATH_INFO: `/v3/users/bc885308f1174e279f2c024d82d5c12b` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:42.202287 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc885308f1174e279f2c024d82d5c12b)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:42.204984 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:42.265670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc885308f1174e279f2c024d82d5c12b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.266529 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc885308f1174e279f2c024d82d5c12b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.287853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc885308f1174e279f2c024d82d5c12b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.288635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc885308f1174e279f2c024d82d5c12b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.297278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ebf5d2b6-08a8-4caf-9b4c-ada22eadfc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc885308f1174e279f2c024d82d5c12b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.318935 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1253/2515] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:42 2022] DELETE /identity/v3/users/bc885308f1174e279f2c024d82d5c12b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:42.507067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:42.508680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:42.525925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea732-c991-475c-bea4-c02e9a73b674 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:42.594811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:42.595804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:42.596157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:42.597070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] PATH_INFO: `/v3/projects/48d53f45bede45c6b768bedfd4499031` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:42.598688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d53f45bede45c6b768bedfd4499031)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:42.600952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:42.655750 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d53f45bede45c6b768bedfd4499031', 'request_id': 'req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.665771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d53f45bede45c6b768bedfd4499031', 'request_id': 'req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.673921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d53f45bede45c6b768bedfd4499031', 'request_id': 'req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.692535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] The token cache is being invalidate because project 48d53f45bede45c6b768bedfd4499031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:42.692899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.693840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-59dd8b5a-6e32-4e3d-a6ce-f6d16c3863f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:42.695878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1263/2516] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:42 2022] DELETE /identity/v3/projects/48d53f45bede45c6b768bedfd4499031 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:42.701027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:42.701502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:42.702017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:42.725550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:42.726812 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:42.787752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1254/2517] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:42.795605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:42.795903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:42.796185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:42.816017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:42.817275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:42.825289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1264/2518] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:42.829580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:42.840248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834038e4-e67a-4acc-a0c9-d750f021b909 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:42.844968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:42.845639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:42.846006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:42.846295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:42.847840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:42.848085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:42.849668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:42.865895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1255/2519] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:42.870140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:42.880815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7a4f-e292-48e6-92fc-de3616f49f58 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:42.886537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:42.886780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:42.887054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:42.887335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:42.888032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:42.889951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:42.920609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1265/2520] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:42 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:42.924677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:42.936119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b6ed-ad64-4582-bd9d-e9d5d74f7dbf admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.014950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.015557 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.015840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.016118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.016846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.019553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.029347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:43.048031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1256/2521] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:42 2022] POST /identity/v3/users => generated 278 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:43.053357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.064866 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3b8d3-be54-428c-b4ea-296ffdb621bc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.071951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.072946 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.073346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.074137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.074604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.076728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.089630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1266/2522] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:43.094114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.106221 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757e567-0b46-4959-bc1e-51af26911794 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.112818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6edad-0095-4c88-9573-7c45084df899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.113721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6edad-0095-4c88-9573-7c45084df899 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.114005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6edad-0095-4c88-9573-7c45084df899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.114282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6edad-0095-4c88-9573-7c45084df899 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.115049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6edad-0095-4c88-9573-7c45084df899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.116647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6edad-0095-4c88-9573-7c45084df899 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.128779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1257/2523] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:43.134695 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.147870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebab8a-5f46-4c59-80dd-4a62ade0f70c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.153133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.154029 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.154482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.154759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] PATH_INFO: `/v3/projects/a1bdbfde0a7e42e7ac67529be65184af/users/98c95181655941bfa33b5c2150720e7e/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.159704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:43.182411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bdbfde0a7e42e7ac67529be65184af, user_id=98c95181655941bfa33b5c2150720e7e, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.185259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.209168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1267/2524] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:43 2022] PUT /identity/v3/projects/a1bdbfde0a7e42e7ac67529be65184af/users/98c95181655941bfa33b5c2150720e7e/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:43.220869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.221167 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.221501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.276983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] MFA Rules not processed for user `98c95181655941bfa33b5c2150720e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:43.278693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:43.405385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1258/2525] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:43 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:43.410395 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.544123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.545617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:43.549997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e239-a991-4c27-ac06-e11b8a5ecb0d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.572412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.572756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b621-d614-41cb-bbbc-dc0a14ce80e9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.573149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.573440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.573719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.574478 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.576411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.580011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.581620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.581939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.582308 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] PATH_INFO: `/v3/users/2d7c42cf0bc84292bb0b7edb9f2e7fc3` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.584147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7c42cf0bc84292bb0b7edb9f2e7fc3)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.586254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.621328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1268/2526] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:43 2022] POST /identity/v3/projects => generated 355 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:43.625467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.643338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7c42cf0bc84292bb0b7edb9f2e7fc3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:43.644166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7c42cf0bc84292bb0b7edb9f2e7fc3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:43.651523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7c42cf0bc84292bb0b7edb9f2e7fc3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:43.652556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7c42cf0bc84292bb0b7edb9f2e7fc3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:43.661897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7c42cf0bc84292bb0b7edb9f2e7fc3'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:43.685721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1259/2527] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:43 2022] DELETE /identity/v3/users/2d7c42cf0bc84292bb0b7edb9f2e7fc3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:43.694162 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8e573-314d-47ef-9634-ab667863210b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.755527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.756200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.756482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.756755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.757441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.759522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.780340 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1269/2528] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:43 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:52:43.784843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.786278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:43.800859 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6e7cd-1a0f-48b7-bdcb-7a30bfd20281 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.807092 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.807807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.808046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.808328 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.809070 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.810983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.826007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1260/2529] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:43.827431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.840803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab1830-0d66-4d53-ad98-7b2c12358af9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.847608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.850525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.853860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.854231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] PATH_INFO: `/v3/projects/42c48982ca6c4637ad5823053ec36fe8/users/6fadba36f9e84e988287607a8031abe0/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.857266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:43.877147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c48982ca6c4637ad5823053ec36fe8, user_id=6fadba36f9e84e988287607a8031abe0, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.880841 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.883082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.885036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:43.899881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9159ed-7633-4270-a751-eec3cb178b9c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.906196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1270/2530] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:43 2022] PUT /identity/v3/projects/42c48982ca6c4637ad5823053ec36fe8/users/6fadba36f9e84e988287607a8031abe0/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:43.910688 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:43.937925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:43.980790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.981667 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.981958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.982243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] PATH_INFO: `/v3/projects/45a72d232f314a78b0e1c3f04b0ed682` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.983512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a72d232f314a78b0e1c3f04b0ed682)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.984360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11592d-db03-4941-ba38-1f4f7c369f0d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:43.985461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:43.989802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:43.990502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:43.990791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:43.991068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:43.991795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:43.993464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.003743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1271/2531] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:44.008356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.019259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35580ad-885c-4e63-8685-33bd8ce9b936 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.024257 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deedecc-6d15-4b83-b3f3-27c8cbc88f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.025176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deedecc-6d15-4b83-b3f3-27c8cbc88f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.025472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deedecc-6d15-4b83-b3f3-27c8cbc88f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.025757 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deedecc-6d15-4b83-b3f3-27c8cbc88f80 admin admin] PATH_INFO: `/v3/projects/42c48982ca6c4637ad5823053ec36fe8/users/6fadba36f9e84e988287607a8031abe0/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.028132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deedecc-6d15-4b83-b3f3-27c8cbc88f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c48982ca6c4637ad5823053ec36fe8, user_id=6fadba36f9e84e988287607a8031abe0, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.031059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deedecc-6d15-4b83-b3f3-27c8cbc88f80 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.043493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1272/2532] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:44 2022] PUT /identity/v3/projects/42c48982ca6c4637ad5823053ec36fe8/users/6fadba36f9e84e988287607a8031abe0/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:44.054952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.055245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.055543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.084855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] MFA Rules not processed for user `6fadba36f9e84e988287607a8031abe0`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:44.086129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.156406 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a72d232f314a78b0e1c3f04b0ed682', 'request_id': 'req-81ad0584-e546-4d7a-a654-33c005b3fabf'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:44.164469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a72d232f314a78b0e1c3f04b0ed682', 'request_id': 'req-81ad0584-e546-4d7a-a654-33c005b3fabf'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:44.165835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1273/2533] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:52:44.171822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a72d232f314a78b0e1c3f04b0ed682', 'request_id': 'req-81ad0584-e546-4d7a-a654-33c005b3fabf'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:44.179144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.180550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.182978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] The token cache is being invalidate because project 45a72d232f314a78b0e1c3f04b0ed682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:44.183271 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:44.183924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-81ad0584-e546-4d7a-a654-33c005b3fabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:44.185479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1261/2534] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:43 2022] DELETE /identity/v3/projects/45a72d232f314a78b0e1c3f04b0ed682 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:44.190241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e8813-3f4c-44dc-beae-9200ca6ee7f9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.190701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e8813-3f4c-44dc-beae-9200ca6ee7f9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.190983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e8813-3f4c-44dc-beae-9200ca6ee7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.208485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ce6e8813-3f4c-44dc-beae-9200ca6ee7f9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:44.209700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ce6e8813-3f4c-44dc-beae-9200ca6ee7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.238910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50334fb-e52b-44e2-b1fd-3f202122e173 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.242554 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:44.268077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1262/2535] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:52:44.276681 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.276974 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.277364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.295040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.295593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.295714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:44.295875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.296149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.296863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.297956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.305577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1263/2536] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:52:44.309843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.319254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9454-e737-434d-8e9c-bdb3e986cb16 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.323886 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.324522 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.324805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.325083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.325804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:44.326113 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.327787 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.340292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1264/2537] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:44.344527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.354929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e67b0-b051-4227-99b2-521e3521bcc9 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.359548 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.360179 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.360467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.360745 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.361429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.363846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.365921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.367393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.377034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1274/2538] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:52:44.389100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1265/2539] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:52:44.393923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.405518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dccdd4-7024-4fae-9a69-678f48c0d28a service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.455512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.457976 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.465160 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.465831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.466114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.466420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.467120 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.469025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.480478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:44.491962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1275/2540] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:44.496567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.507806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803a9a-4fee-42f7-bcc9-94d05032bda2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.512541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.513191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.513495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.513783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.514538 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.516141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.518591 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d94f6-b001-4bab-83e8-1ab2310cd2c0 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.522203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.522874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.523159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.523437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.525216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.529242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1276/2541] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:44.530541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.540166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9b2d5-42ba-4d0b-8540-bcc12a0bc0ba admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.545344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.545918 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.546208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.549316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.549316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.549316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.560124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1277/2542] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:44.564237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.574390 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f61fe-c015-4280-9b2b-1836a95e5d4d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.579204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.580092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.580370 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.580649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] PATH_INFO: `/v3/projects/2963bde44fe64026828c54644dc4c664/users/bd90037f25264fc5a8fab1f7fc7686ab/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.596184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2963bde44fe64026828c54644dc4c664, user_id=bd90037f25264fc5a8fab1f7fc7686ab, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.596648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.598228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98be753-937f-47d5-8412-cee151e1b1d5 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.599220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.607734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1266/2543] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:52:44.609269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:44.620258 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1278/2544] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:44 2022] PUT /identity/v3/projects/2963bde44fe64026828c54644dc4c664/users/bd90037f25264fc5a8fab1f7fc7686ab/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:44.631873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.632176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.632460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.662226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] MFA Rules not processed for user `bd90037f25264fc5a8fab1f7fc7686ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:44.663504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:44.760928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1267/2545] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:44.766790 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.833898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de161c-9263-4978-9ab2-460117b5d62c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.839621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.840717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.840991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.841264 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.842005 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.843916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.876945 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1279/2546] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:52:44.878730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:44.889303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc19e5-5598-4f48-965c-82325d2e57bd None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:44.966058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:44.966739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:44.967018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:44.967297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:44.968036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:44.972069 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:44.983002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:44.998890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1268/2547] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:44 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:52:45.003263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:45.015014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801f46-6c7d-4416-a0b8-a27dcb694f45 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:45.020807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:45.021528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.021817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.022100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.022891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:45.024510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:45.042405 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1280/2548] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:45.045881 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:45.057038 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a8e0c-41ff-4a6a-8206-a3a865468e91 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:45.061537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:45.062459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.062747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.063028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] PATH_INFO: `/v3/projects/73263c0c107546a28d35e4eddaccdeb8/users/d2b657a0efc649b3890b5932edf7df18/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.078939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73263c0c107546a28d35e4eddaccdeb8, user_id=d2b657a0efc649b3890b5932edf7df18, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:45.082250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:45.095280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1269/2549] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:45 2022] PUT /identity/v3/projects/73263c0c107546a28d35e4eddaccdeb8/users/d2b657a0efc649b3890b5932edf7df18/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:45.100447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:45.110494 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae82600-401b-4822-b173-a311413dd4f0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:45.164667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3af8d-94b7-4e4b-aead-a8d05eaa2535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:45.165322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3af8d-94b7-4e4b-aead-a8d05eaa2535 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.165603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3af8d-94b7-4e4b-aead-a8d05eaa2535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.165878 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3af8d-94b7-4e4b-aead-a8d05eaa2535 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.166891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3af8d-94b7-4e4b-aead-a8d05eaa2535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:45.168467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3af8d-94b7-4e4b-aead-a8d05eaa2535 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:45.177855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1281/2550] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:45.182210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:45.192498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947def-35b8-45e7-b876-2f7dbe3adcc3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:45.197003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:45.197872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.198149 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.198459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] PATH_INFO: `/v3/projects/73263c0c107546a28d35e4eddaccdeb8/users/d2b657a0efc649b3890b5932edf7df18/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.200390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73263c0c107546a28d35e4eddaccdeb8, user_id=d2b657a0efc649b3890b5932edf7df18, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:45.203047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:45.214798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1270/2551] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:45 2022] PUT /identity/v3/projects/73263c0c107546a28d35e4eddaccdeb8/users/d2b657a0efc649b3890b5932edf7df18/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:45.225559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.225851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.226247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.253502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] MFA Rules not processed for user `d2b657a0efc649b3890b5932edf7df18`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:45.254668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:45.312195 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:45.321591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1282/2552] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:45.333338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:45.335103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:45.390669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb55abf-2a70-4702-85ea-ae76c353c4d3 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:45.395042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:45.395708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.395972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.396251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.405849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:45.407304 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:45.417059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1271/2553] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:45.465295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:45.476166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f38ae0-bbd2-46b0-b786-e05b3cc3a3b1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:45.480056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f4044-2597-4d93-a96d-e24408b049e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:45.480691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f4044-2597-4d93-a96d-e24408b049e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:45.480980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f4044-2597-4d93-a96d-e24408b049e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:45.481261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f4044-2597-4d93-a96d-e24408b049e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:45.538628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f4044-2597-4d93-a96d-e24408b049e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:45.540059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f4044-2597-4d93-a96d-e24408b049e3 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:45.549180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1283/2554] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:49.070542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:49.147141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecf6ad-99a5-49f2-bea7-a46cf563dab4 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:49.151739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:49.152960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:49.153555 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:49.154087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] PATH_INFO: `/v3/users/bd90037f25264fc5a8fab1f7fc7686ab` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:49.155896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd90037f25264fc5a8fab1f7fc7686ab)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:49.158626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:49.215309 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd90037f25264fc5a8fab1f7fc7686ab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.215969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd90037f25264fc5a8fab1f7fc7686ab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.223771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd90037f25264fc5a8fab1f7fc7686ab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.224479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd90037f25264fc5a8fab1f7fc7686ab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.229312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:49.234807 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd90037f25264fc5a8fab1f7fc7686ab'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.260255 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1272/2555] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:49 2022] DELETE /identity/v3/users/bd90037f25264fc5a8fab1f7fc7686ab => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:49.264926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:49.265493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:49.265493 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:49.287943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:49.289190 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:49.368107 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1284/2556] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:49.379434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:49.380898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:49.452281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f0b7-8254-4f4b-845b-0ec09d0f99d5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:49.456480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:49.457193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:49.457477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:49.457756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:49.467191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:49.468669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:49.479424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1273/2557] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:49.755550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:49.757071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:49.770619 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6119-4694-4604-b53f-c25e940be563 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:49.775475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:49.776555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:49.776859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:49.777192 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] PATH_INFO: `/v3/projects/2963bde44fe64026828c54644dc4c664` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:49.778560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2963bde44fe64026828c54644dc4c664)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:49.780685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:49.828387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2963bde44fe64026828c54644dc4c664', 'request_id': 'req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.834276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2963bde44fe64026828c54644dc4c664', 'request_id': 'req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.840269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2963bde44fe64026828c54644dc4c664', 'request_id': 'req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.852605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] The token cache is being invalidate because project 2963bde44fe64026828c54644dc4c664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:49.852922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.853563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.855132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1285/2558] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:49 2022] DELETE /identity/v3/projects/2963bde44fe64026828c54644dc4c664 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:49.859145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:49.868628 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1480-2e67-449a-8874-7cc065c51db9 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:49.927463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:49.928317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:49.928597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:49.928872 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] PATH_INFO: `/v3/users/d2b657a0efc649b3890b5932edf7df18` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:49.930040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b657a0efc649b3890b5932edf7df18)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:49.931988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:49.977549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b657a0efc649b3890b5932edf7df18'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.978137 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b657a0efc649b3890b5932edf7df18'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.985091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b657a0efc649b3890b5932edf7df18'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.985792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b657a0efc649b3890b5932edf7df18'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:49.992422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8352c39c-4d5d-408b-abe5-6a2367ecd00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b657a0efc649b3890b5932edf7df18'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:50.007482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:50.012539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1274/2559] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:49 2022] DELETE /identity/v3/users/d2b657a0efc649b3890b5932edf7df18 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:50.306847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.308428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:50.328547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db9b3-02f3-436f-9ab2-2b768b4e6a57 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.349044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:50.405312 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.406218 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.406557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.406837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] PATH_INFO: `/v3/projects/73263c0c107546a28d35e4eddaccdeb8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.408106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73263c0c107546a28d35e4eddaccdeb8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.410689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.462297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73263c0c107546a28d35e4eddaccdeb8', 'request_id': 'req-b0a116ad-1300-42ce-b767-3adbd08486d4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:50.467651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73263c0c107546a28d35e4eddaccdeb8', 'request_id': 'req-b0a116ad-1300-42ce-b767-3adbd08486d4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:50.474453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73263c0c107546a28d35e4eddaccdeb8', 'request_id': 'req-b0a116ad-1300-42ce-b767-3adbd08486d4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:50.487865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] The token cache is being invalidate because project 73263c0c107546a28d35e4eddaccdeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:50.488282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:50.488937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0a116ad-1300-42ce-b767-3adbd08486d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:50.490504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1286/2560] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:50 2022] DELETE /identity/v3/projects/73263c0c107546a28d35e4eddaccdeb8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:50.495402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.495852 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.495948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.513583 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:50.514891 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:50.572686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1275/2561] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:50.581362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.581748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.582039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.601743 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:50.603052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:50.611191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1287/2562] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:50.616125 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.625726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9c46-9d95-4607-9974-bd793db33450 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.630404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.631060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.631344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.631621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.632346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:50.632655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.634254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.645727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1276/2563] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:50.649920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.659929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec928eda-269a-417a-8999-e41834e7cb5b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.664600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.665252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.665541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.665823 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.666819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.668759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.695233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1288/2564] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:50 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:50.699428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.709604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cf3f4-733a-4cab-b7d5-376f494a649e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.765711 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.766291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.766620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.766901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.767618 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.769713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.790789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1277/2565] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:50 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:50.795025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.806147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234e48-5edd-42c2-9bae-51e2aba33d7b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.810821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.811472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.811756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.812033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.812923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.814722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.825150 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1289/2566] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:50.829014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.839294 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c879-ee12-473a-9064-6ffafc1f8d98 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.843870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceb18e-c285-47be-a3e1-39d7cc842edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.844524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceb18e-c285-47be-a3e1-39d7cc842edd admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.844810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceb18e-c285-47be-a3e1-39d7cc842edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.845087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceb18e-c285-47be-a3e1-39d7cc842edd admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.845814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceb18e-c285-47be-a3e1-39d7cc842edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.848196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceb18e-c285-47be-a3e1-39d7cc842edd admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.858030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1278/2567] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:50.862331 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:50.872094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead0b9f-131a-48b6-86af-e17fffb9e3fd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:50.876693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:50.877623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.877993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.878270 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] PATH_INFO: `/v3/projects/357d1eabb952496081a22b8636eebee2/users/ff9c643faf4b4b1999cdbcfd53625d5e/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.892897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357d1eabb952496081a22b8636eebee2, user_id=ff9c643faf4b4b1999cdbcfd53625d5e, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:50.896354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:50.909650 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1290/2568] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:50 2022] PUT /identity/v3/projects/357d1eabb952496081a22b8636eebee2/users/ff9c643faf4b4b1999cdbcfd53625d5e/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:50.920245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:50.920542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:50.920826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:50.947610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] MFA Rules not processed for user `ff9c643faf4b4b1999cdbcfd53625d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:50.948808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:51.003072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:51.013018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1279/2569] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:51.017672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.063015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:51.080557 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef5f0-571c-4924-bbdb-c1467b95e1c8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.085807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.086522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.086808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.087086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.087770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.089659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.114768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1291/2570] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:51 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:51.119012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.130010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176420c-84a7-40d1-8b95-ba799c7e4dfd None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.185366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.185902 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.186186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.186495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.187186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.189226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.209565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1280/2571] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:51 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:51.213604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.224056 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f69c-c6f3-4d65-85ac-8b04a667ee94 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.228672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.229332 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.229617 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.229897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.230656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.232225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.246530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1292/2572] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:51.247569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.258459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a90c-0982-4dd5-a6ec-23d30f3aed02 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.262988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.263863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.264143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.264495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] PATH_INFO: `/v3/projects/6c82f4245dde4f5c86b22d3de1720c3a/users/0bccf4e7c67345e5b094e713cd1c70c5/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.279925 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c82f4245dde4f5c86b22d3de1720c3a, user_id=0bccf4e7c67345e5b094e713cd1c70c5, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.282519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.298763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1281/2573] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:51 2022] PUT /identity/v3/projects/6c82f4245dde4f5c86b22d3de1720c3a/users/0bccf4e7c67345e5b094e713cd1c70c5/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:51.303106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.313854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3802d9-3e5c-4d8f-bfa8-ba253e4be231 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.371653 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4949ff7-e16e-419c-b779-d196b42ec2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.372330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4949ff7-e16e-419c-b779-d196b42ec2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.372620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4949ff7-e16e-419c-b779-d196b42ec2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.372904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4949ff7-e16e-419c-b779-d196b42ec2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.373638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4949ff7-e16e-419c-b779-d196b42ec2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.375606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4949ff7-e16e-419c-b779-d196b42ec2d6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.386186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1293/2574] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:51.390900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.402505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b733-ab6a-4423-b5e1-d40c2d8c5b4d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.407710 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.408593 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.408931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.409352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] PATH_INFO: `/v3/projects/6c82f4245dde4f5c86b22d3de1720c3a/users/0bccf4e7c67345e5b094e713cd1c70c5/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.411746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c82f4245dde4f5c86b22d3de1720c3a, user_id=0bccf4e7c67345e5b094e713cd1c70c5, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.414888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.438446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1282/2575] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:51 2022] PUT /identity/v3/projects/6c82f4245dde4f5c86b22d3de1720c3a/users/0bccf4e7c67345e5b094e713cd1c70c5/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:51.442106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.442825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.443397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.479028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] MFA Rules not processed for user `0bccf4e7c67345e5b094e713cd1c70c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:51.480281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:51.575530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1294/2576] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:51.607707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.609626 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:51.672251 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155086-5771-4ca0-9264-38c7f1694ceb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.676706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.677352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.677634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.677942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.688228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.689545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.700210 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1283/2577] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:51.780729 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:51.791628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd78f3-14d9-48fb-bb4d-81dc5356388e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:51.795208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda703a4-6632-40d3-a07d-23e0fa73c59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:51.795847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda703a4-6632-40d3-a07d-23e0fa73c59d service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:51.796129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda703a4-6632-40d3-a07d-23e0fa73c59d service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:51.796401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda703a4-6632-40d3-a07d-23e0fa73c59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:51.841169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:51.863832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda703a4-6632-40d3-a07d-23e0fa73c59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:51.865337 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda703a4-6632-40d3-a07d-23e0fa73c59d service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:51.875761 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1295/2578] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:58.152986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:58.206813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:58.219601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b994c7-4b79-4684-95cc-6518d72c959f service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:58.225474 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:58.226425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:58.226707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:58.226980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] PATH_INFO: `/v3/users/ff9c643faf4b4b1999cdbcfd53625d5e` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:58.228163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9c643faf4b4b1999cdbcfd53625d5e)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:58.230099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:58.277968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9c643faf4b4b1999cdbcfd53625d5e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.279576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9c643faf4b4b1999cdbcfd53625d5e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.287389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9c643faf4b4b1999cdbcfd53625d5e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.288055 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9c643faf4b4b1999cdbcfd53625d5e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.294946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9c643faf4b4b1999cdbcfd53625d5e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.313813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1284/2579] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:58 2022] DELETE /identity/v3/users/ff9c643faf4b4b1999cdbcfd53625d5e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:58.318910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:58.319384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:58.319480 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:58.337153 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:58.338389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:58.400671 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1296/2580] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:58.411846 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:58.413244 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:58.472869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79242788-0841-41ac-8e7d-05b18addc819 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:58.476361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:58.477007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:58.477293 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:58.477572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:58.486698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:58.488320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:58.498090 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1285/2581] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:52:58.769942 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:58.771442 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:58.783463 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff499-4f02-44b0-b687-3360d8597d87 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:58.789014 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:58.789891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:58.790178 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:58.790489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] PATH_INFO: `/v3/projects/357d1eabb952496081a22b8636eebee2` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:58.792090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=357d1eabb952496081a22b8636eebee2)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:58.794237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:58.843730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357d1eabb952496081a22b8636eebee2', 'request_id': 'req-993452f5-d491-4618-8a70-836e349bfc0b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.849722 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357d1eabb952496081a22b8636eebee2', 'request_id': 'req-993452f5-d491-4618-8a70-836e349bfc0b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.856073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357d1eabb952496081a22b8636eebee2', 'request_id': 'req-993452f5-d491-4618-8a70-836e349bfc0b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.868716 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] The token cache is being invalidate because project 357d1eabb952496081a22b8636eebee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:58.869011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.869630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.871225 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1297/2582] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:58 2022] DELETE /identity/v3/projects/357d1eabb952496081a22b8636eebee2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:52:58.875213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:58.885209 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054462-3c6c-4590-9939-1f8c40a37bd9 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:58.941916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:58.942821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:58.943103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:58.943382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] PATH_INFO: `/v3/users/0bccf4e7c67345e5b094e713cd1c70c5` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:58.944558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bccf4e7c67345e5b094e713cd1c70c5)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:58.946501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:58.960584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:58.994329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bccf4e7c67345e5b094e713cd1c70c5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:58.995009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bccf4e7c67345e5b094e713cd1c70c5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.002063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bccf4e7c67345e5b094e713cd1c70c5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.002798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bccf4e7c67345e5b094e713cd1c70c5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.010719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ce74d262-efc2-467d-83d9-ecee4b22f1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bccf4e7c67345e5b094e713cd1c70c5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.028049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1286/2583] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:58 2022] DELETE /identity/v3/users/0bccf4e7c67345e5b094e713cd1c70c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:59.322284 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.326432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:59.340981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993452f5-d491-4618-8a70-836e349bfc0b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.401341 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.402242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.402566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.402956 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] PATH_INFO: `/v3/projects/6c82f4245dde4f5c86b22d3de1720c3a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.404074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c82f4245dde4f5c86b22d3de1720c3a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.406115 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.408766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:59.458521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c82f4245dde4f5c86b22d3de1720c3a', 'request_id': 'req-366115d8-d964-4e12-aa0f-02ba3e6b87ae'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.463910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c82f4245dde4f5c86b22d3de1720c3a', 'request_id': 'req-366115d8-d964-4e12-aa0f-02ba3e6b87ae'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.470680 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c82f4245dde4f5c86b22d3de1720c3a', 'request_id': 'req-366115d8-d964-4e12-aa0f-02ba3e6b87ae'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.484425 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] The token cache is being invalidate because project 6c82f4245dde4f5c86b22d3de1720c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:59.484560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.485204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-366115d8-d964-4e12-aa0f-02ba3e6b87ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:59.487092 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1298/2584] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:59 2022] DELETE /identity/v3/projects/6c82f4245dde4f5c86b22d3de1720c3a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:59.492176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.492652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.492769 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.512310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:59.513774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:59.580242 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1287/2585] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:59.588588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.588883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.589167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.607654 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:59.608875 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:59.616936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1299/2586] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:52:59.621191 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.631532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9c9d-90da-4e57-af29-d8dce5580e5b None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.636171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.636823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.637109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.637391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.638117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:52:59.638469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.640067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.652506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1288/2587] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:52:59.657173 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.667365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c7077-164a-4277-8aca-43f2f2fb5b7d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.672806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.673475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.673843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.674121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.674880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.676954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.703941 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1300/2588] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:52:59 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:59.709045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.718905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051fb6-df2b-4aa3-bd03-a00bd9c6852a admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.776739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.777408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.777698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.777981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.778854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.780813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.801732 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1289/2589] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:52:59 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:52:59.806123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.818276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896c6e-6c3f-4575-9121-4ed11427dd1f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.823980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.824679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.824963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.825241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.825980 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.827655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.838631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1301/2590] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:59.842863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.854020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d22d-3616-418c-a495-afea1379d4b0 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.859707 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6463d13-8012-40e7-a995-efda4890c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.860537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463d13-8012-40e7-a995-efda4890c239 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.860828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463d13-8012-40e7-a995-efda4890c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.861111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463d13-8012-40e7-a995-efda4890c239 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.862574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6463d13-8012-40e7-a995-efda4890c239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.864821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6463d13-8012-40e7-a995-efda4890c239 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.867246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:59.882310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1290/2591] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:52:59.883747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:59.896313 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5587c0-5e66-456e-9a2d-46084baf6704 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:59.901441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:59.902325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.902636 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.902913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] PATH_INFO: `/v3/projects/337fe1eeeb1f4bd784ae8a091dbc336c/users/0a78bfef9e944c93868d9c700434c182/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.917966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337fe1eeeb1f4bd784ae8a091dbc336c, user_id=0a78bfef9e944c93868d9c700434c182, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:59.920639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:59.934208 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1302/2592] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:52:59 2022] PUT /identity/v3/projects/337fe1eeeb1f4bd784ae8a091dbc336c/users/0a78bfef9e944c93868d9c700434c182/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:59.945546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:59.945836 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:59.946115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:59.972740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] MFA Rules not processed for user `0a78bfef9e944c93868d9c700434c182`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:52:59.973933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:00.035943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1291/2593] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:52:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:00.040431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.101440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716138-5314-4c29-97de-a72f2d007297 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.105901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.106676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.106961 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.107238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.107911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.109789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.133988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1303/2594] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:00 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:00.138099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.149094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955635-3b35-430e-9125-51b9cb0a50f7 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.203813 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.204485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.204755 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.205033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.206306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.208367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.227964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1292/2595] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:00 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:00.232086 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.242479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947c3e-5408-4cf3-8f77-7231be79a7d3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.247901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.248698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.248785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.249022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.249751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.251404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.262812 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1304/2596] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:00.267257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.278073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd3d8f-e5f9-4c91-8773-5188bcd91d12 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.282931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.283845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.284237 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.284638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] PATH_INFO: `/v3/projects/cbe4bec64ab44fd887ee4cc502a91cc8/users/5e4d2073a2074bf9bb6b2cd4d8a35878/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.300424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe4bec64ab44fd887ee4cc502a91cc8, user_id=5e4d2073a2074bf9bb6b2cd4d8a35878, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.303083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.322310 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.322843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1293/2597] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:00 2022] PUT /identity/v3/projects/cbe4bec64ab44fd887ee4cc502a91cc8/users/5e4d2073a2074bf9bb6b2cd4d8a35878/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:00.327865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:00.335690 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ef0e-2079-4925-adf5-708be5be4b96 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.395481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fe1d8-4834-4d0e-9370-9ef2df971d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.396163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe1d8-4834-4d0e-9370-9ef2df971d9c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.396444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe1d8-4834-4d0e-9370-9ef2df971d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.396763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe1d8-4834-4d0e-9370-9ef2df971d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.397519 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fe1d8-4834-4d0e-9370-9ef2df971d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.399282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fe1d8-4834-4d0e-9370-9ef2df971d9c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.411090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1305/2598] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:00.415233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.426009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b1ba9-4f76-4fd1-ba22-13ed24941980 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.430688 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.431569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.431850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.432127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] PATH_INFO: `/v3/projects/cbe4bec64ab44fd887ee4cc502a91cc8/users/5e4d2073a2074bf9bb6b2cd4d8a35878/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.434078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe4bec64ab44fd887ee4cc502a91cc8, user_id=5e4d2073a2074bf9bb6b2cd4d8a35878, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.436753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.448275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1294/2599] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:00 2022] PUT /identity/v3/projects/cbe4bec64ab44fd887ee4cc502a91cc8/users/5e4d2073a2074bf9bb6b2cd4d8a35878/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:00.459796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.460094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.460456 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.489832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] MFA Rules not processed for user `5e4d2073a2074bf9bb6b2cd4d8a35878`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:00.491157 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:00.569551 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1306/2600] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:00.581360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.583194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:00.630597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:00.647376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689baec-e636-4620-886f-63971f9fc6b2 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.651091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.651744 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.652035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.652357 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.663319 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.664834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.675849 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1295/2601] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:00.753465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:00.763401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478d28-4a22-46be-afc1-d348c500d03f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:00.767085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307dd39-b34c-47c6-bef2-9f10d8c85149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:00.767721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307dd39-b34c-47c6-bef2-9f10d8c85149 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:00.768000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307dd39-b34c-47c6-bef2-9f10d8c85149 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:00.768901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307dd39-b34c-47c6-bef2-9f10d8c85149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:00.838132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307dd39-b34c-47c6-bef2-9f10d8c85149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:00.839633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307dd39-b34c-47c6-bef2-9f10d8c85149 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:00.851459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1307/2602] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:03.253704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:03.255527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:03.321310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802d084-7489-43fa-b051-c89f589b8662 service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:03.325759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:03.326799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:03.327084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:03.327365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] PATH_INFO: `/v3/users/98c95181655941bfa33b5c2150720e7e` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:03.328539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c95181655941bfa33b5c2150720e7e)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:03.330455 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:03.381946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c95181655941bfa33b5c2150720e7e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:03.382660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c95181655941bfa33b5c2150720e7e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:03.389624 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c95181655941bfa33b5c2150720e7e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:03.390459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c95181655941bfa33b5c2150720e7e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:03.400690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c95181655941bfa33b5c2150720e7e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:03.421616 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1296/2603] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:03 2022] DELETE /identity/v3/users/98c95181655941bfa33b5c2150720e7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:03.426112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:03.427021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:03.427021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:03.458266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:03.500955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:03.502492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:03.619850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1308/2604] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:03.629629 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:03.631136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:03.713644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:03.724258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c2b6-2e25-4cbe-ade4-b030cf300f42 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:03.727806 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:03.728447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:03.729078 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:03.729431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:03.739217 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:03.740890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:03.750412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1297/2605] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:04.043541 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:04.044744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:04.057762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1f83-f720-45dd-bc8d-a5cf89253415 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:04.062831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:04.063686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.063972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.064249 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] PATH_INFO: `/v3/projects/a1bdbfde0a7e42e7ac67529be65184af` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.065441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bdbfde0a7e42e7ac67529be65184af)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:04.067730 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:04.121392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bdbfde0a7e42e7ac67529be65184af', 'request_id': 'req-cbe99518-b60e-46c8-add2-e178a47d37bb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.127348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bdbfde0a7e42e7ac67529be65184af', 'request_id': 'req-cbe99518-b60e-46c8-add2-e178a47d37bb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.133879 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bdbfde0a7e42e7ac67529be65184af', 'request_id': 'req-cbe99518-b60e-46c8-add2-e178a47d37bb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.149820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] The token cache is being invalidate because project a1bdbfde0a7e42e7ac67529be65184af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:04.150191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.150929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.152475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1309/2606] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:04 2022] DELETE /identity/v3/projects/a1bdbfde0a7e42e7ac67529be65184af => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:04.156492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:04.166246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040358c-5a45-4518-8628-cfd590366500 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:04.227986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:04.229036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.229340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.229735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] PATH_INFO: `/v3/users/6fadba36f9e84e988287607a8031abe0` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.231631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fadba36f9e84e988287607a8031abe0)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:04.233552 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:04.288634 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fadba36f9e84e988287607a8031abe0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.289556 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fadba36f9e84e988287607a8031abe0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.298800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fadba36f9e84e988287607a8031abe0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.299563 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fadba36f9e84e988287607a8031abe0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.309002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-270fabde-83a9-41ae-937a-1a1ec1cccac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fadba36f9e84e988287607a8031abe0'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.330901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1298/2607] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:04 2022] DELETE /identity/v3/users/6fadba36f9e84e988287607a8031abe0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:04.613164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:04.615553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:04.628913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe99518-b60e-46c8-add2-e178a47d37bb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:04.662343 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:04.688783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:04.689666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.689944 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.690227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] PATH_INFO: `/v3/projects/42c48982ca6c4637ad5823053ec36fe8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.691532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c48982ca6c4637ad5823053ec36fe8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:04.693862 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:04.742015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c48982ca6c4637ad5823053ec36fe8', 'request_id': 'req-b9a355b0-63fa-4507-923f-85350d0a956c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.747430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c48982ca6c4637ad5823053ec36fe8', 'request_id': 'req-b9a355b0-63fa-4507-923f-85350d0a956c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.753336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c48982ca6c4637ad5823053ec36fe8', 'request_id': 'req-b9a355b0-63fa-4507-923f-85350d0a956c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.765673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] The token cache is being invalidate because project 42c48982ca6c4637ad5823053ec36fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:04.765966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.766622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b9a355b0-63fa-4507-923f-85350d0a956c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:04.768202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1310/2608] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:04 2022] DELETE /identity/v3/projects/42c48982ca6c4637ad5823053ec36fe8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:04.773908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.774199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.774541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.821236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:04.822498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:04.855491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:04.881916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1299/2609] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:04.889744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.890043 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.890333 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.909077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:04.910315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:04.919530 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1311/2610] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:04.923996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:04.934715 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7bf8-b2ab-429c-93ce-902f81f90769 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:04.939317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:04.939975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.940260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.940539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.941265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:04.941571 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:04.943299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:04.956342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1300/2611] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:04.960376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:04.969481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e5e22-b12c-4270-ab09-6aab15825779 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:04.974904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:04.975545 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:04.975826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:04.976102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:04.976826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:04.978746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.003885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1312/2612] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:04 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:05.007995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.017868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5243e96-500e-4fdb-87d6-da609a62ce81 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.075404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.075970 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.076256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.076536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.077220 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.079177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.098906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1301/2613] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:05 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:05.103089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.113685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d033-18bd-468e-af7b-dc64356e30f6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.118434 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.119163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.119613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.119901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.120665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.122256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.133252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1313/2614] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:05.137162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.147565 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ea0a-ab7e-461b-9fe4-5bd7f0f9d401 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.152124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e05e-6e0b-4194-9255-be52240e761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.152774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e05e-6e0b-4194-9255-be52240e761f admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.153060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e05e-6e0b-4194-9255-be52240e761f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.153343 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e05e-6e0b-4194-9255-be52240e761f admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.154067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e05e-6e0b-4194-9255-be52240e761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.155694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e05e-6e0b-4194-9255-be52240e761f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.165509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1302/2615] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:05.169842 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.179715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158fbbd-37f6-4493-8c01-30b575b8cdce admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.184251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.185118 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.185400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.185678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] PATH_INFO: `/v3/projects/8f4c31c45b9c486488b093ac1ce1cfa1/users/e4132428b0484b23acc76cccb0dfa2d8/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.200424 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4c31c45b9c486488b093ac1ce1cfa1, user_id=e4132428b0484b23acc76cccb0dfa2d8, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.203089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.217099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1314/2616] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:05 2022] PUT /identity/v3/projects/8f4c31c45b9c486488b093ac1ce1cfa1/users/e4132428b0484b23acc76cccb0dfa2d8/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:05.228465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.228761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.229047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.255377 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] MFA Rules not processed for user `e4132428b0484b23acc76cccb0dfa2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:05.256632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:05.320164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1303/2617] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:05.324637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.387437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a674-8826-41d8-a34a-c2aebc49affd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.392101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.392755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.393044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.393371 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.394055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.397172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.405975 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:05.425821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1315/2618] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:05 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:05.430481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.441081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8fa2c-0e89-4d96-b879-18ea6af2b348 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.476177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:05.503461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.504140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.504615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.504857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.505569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.507519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.528415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1304/2619] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:05 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:05.532274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.543672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424a48-d93a-4851-bf86-5d75fb68c294 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.548288 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.548938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.549229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.549511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.550241 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.552039 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.562286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1316/2620] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:05.566226 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.576401 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840ecfc-fdc6-4ad9-b4ee-14cb1cdb1268 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.581193 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.582081 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.582911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.583207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] PATH_INFO: `/v3/projects/2597f2ae0d014e189fe88632add4b751/users/34a4badef4da432e907a33d2e833d45c/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.598145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2597f2ae0d014e189fe88632add4b751, user_id=34a4badef4da432e907a33d2e833d45c, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.601336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.613509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1305/2621] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:05 2022] PUT /identity/v3/projects/2597f2ae0d014e189fe88632add4b751/users/34a4badef4da432e907a33d2e833d45c/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:05.617497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.627540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853938cf-7131-4c97-a34c-b17f3035b3d3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.689094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88c4b-289f-4144-8762-502f86f0aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.689771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88c4b-289f-4144-8762-502f86f0aa68 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.690065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88c4b-289f-4144-8762-502f86f0aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.690345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88c4b-289f-4144-8762-502f86f0aa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.691112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88c4b-289f-4144-8762-502f86f0aa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.692741 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88c4b-289f-4144-8762-502f86f0aa68 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.702773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1317/2622] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:05.706916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.718048 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ad8a-52a2-4d51-88b6-ab7dca18029e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.722838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.724341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.724620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.724897 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] PATH_INFO: `/v3/projects/2597f2ae0d014e189fe88632add4b751/users/34a4badef4da432e907a33d2e833d45c/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.727008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2597f2ae0d014e189fe88632add4b751, user_id=34a4badef4da432e907a33d2e833d45c, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.729621 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.740620 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1306/2623] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:05 2022] PUT /identity/v3/projects/2597f2ae0d014e189fe88632add4b751/users/34a4badef4da432e907a33d2e833d45c/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:05.750664 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.750957 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.751238 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.777318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] MFA Rules not processed for user `34a4badef4da432e907a33d2e833d45c`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:05.778564 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:05.845885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1318/2624] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:05.857140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:05.858908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:05.918085 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6b8bc-b7fb-4e4a-8a61-4bb0c281c35f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:05.921814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b62e-8094-4d6f-bd1e-e04b9a1bedd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:05.922481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b62e-8094-4d6f-bd1e-e04b9a1bedd7 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:05.922789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b62e-8094-4d6f-bd1e-e04b9a1bedd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:05.923079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b62e-8094-4d6f-bd1e-e04b9a1bedd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:05.932130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b62e-8094-4d6f-bd1e-e04b9a1bedd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:05.933551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b62e-8094-4d6f-bd1e-e04b9a1bedd7 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:05.943800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1307/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:06.007808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:06.069801 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ba2c3-bbde-44ed-85cd-6de96c7dfcf0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:06.074328 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:06.075200 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.075485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.075763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] PATH_INFO: `/v3/users/e4132428b0484b23acc76cccb0dfa2d8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.076962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4132428b0484b23acc76cccb0dfa2d8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:06.078898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:06.080375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:06.126083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4132428b0484b23acc76cccb0dfa2d8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.138096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4132428b0484b23acc76cccb0dfa2d8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.138795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4132428b0484b23acc76cccb0dfa2d8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.139412 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4132428b0484b23acc76cccb0dfa2d8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.146193 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4132428b0484b23acc76cccb0dfa2d8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.157933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1319/2626] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:06 2022] DELETE /identity/v3/users/e4132428b0484b23acc76cccb0dfa2d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:06.163084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.163374 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.163650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.181430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:06.182659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:06.240020 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1308/2627] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:06.252275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:06.253696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:06.310067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a872-9647-4176-b36f-924b15bdd748 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:06.313656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:06.314289 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.314604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.314881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.324025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:06.325500 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:06.336123 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1320/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:06.632005 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:06.636785 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:06.682300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949aae-0c71-4564-ad2f-5481a907d7aa None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:06.695741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:06.695741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.695741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.695741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] PATH_INFO: `/v3/projects/8f4c31c45b9c486488b093ac1ce1cfa1` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.699233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4c31c45b9c486488b093ac1ce1cfa1)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:06.701322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:06.717787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:06.720066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:06.735546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:06.736108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8518e6-f99d-454d-b63e-f711492a9208 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:06.743276 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:06.744355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.744814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.745383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] PATH_INFO: `/v3/users/0a78bfef9e944c93868d9c700434c182` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.746733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a78bfef9e944c93868d9c700434c182)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:06.748665 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:06.759362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4c31c45b9c486488b093ac1ce1cfa1', 'request_id': 'req-408a713b-5c4f-4b69-be29-6eb0217ffc99'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.769486 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4c31c45b9c486488b093ac1ce1cfa1', 'request_id': 'req-408a713b-5c4f-4b69-be29-6eb0217ffc99'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.779224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4c31c45b9c486488b093ac1ce1cfa1', 'request_id': 'req-408a713b-5c4f-4b69-be29-6eb0217ffc99'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.792960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] The token cache is being invalidate because project 8f4c31c45b9c486488b093ac1ce1cfa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:06.793512 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.794182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.795768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1309/2629] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:06 2022] DELETE /identity/v3/projects/8f4c31c45b9c486488b093ac1ce1cfa1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:06.799726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:06.801166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:06.805362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a78bfef9e944c93868d9c700434c182'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.821355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a78bfef9e944c93868d9c700434c182'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.822147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a78bfef9e944c93868d9c700434c182'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.822910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a78bfef9e944c93868d9c700434c182'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.833840 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93f5b282-5c5a-4fd6-ab6d-b02142db9697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a78bfef9e944c93868d9c700434c182'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:06.837207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:06.854930 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1321/2630] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:06 2022] DELETE /identity/v3/users/0a78bfef9e944c93868d9c700434c182 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:06.860269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.860563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.860845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.879027 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:06.880811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a713b-5c4f-4b69-be29-6eb0217ffc99 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:06.881023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:06.946043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:06.947109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:06.947536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:06.947847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] PATH_INFO: `/v3/users/34a4badef4da432e907a33d2e833d45c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:06.949578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a4badef4da432e907a33d2e833d45c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:06.951671 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:06.953794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1322/2631] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:06.965366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:06.966969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.019044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a4badef4da432e907a33d2e833d45c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.019779 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a4badef4da432e907a33d2e833d45c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.027877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a4badef4da432e907a33d2e833d45c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.028647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a4badef4da432e907a33d2e833d45c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.036014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a4badef4da432e907a33d2e833d45c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.037456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:07.040436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f87c06-3a2a-4579-8279-b4d7631b551e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:07.044719 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:07.045394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.045678 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.045955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.047987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.057518 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1310/2632] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:06 2022] DELETE /identity/v3/users/34a4badef4da432e907a33d2e833d45c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:07.061642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:07.063179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:07.074036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1323/2633] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:07.438834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:07.441322 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.465152 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:07.466908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.484906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78683-11b0-4bb9-b022-8adc83ad9331 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:07.574391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7564-1a20-4599-b0be-91fbc0de9a87 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:07.577274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:07.578296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.578712 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.579074 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] PATH_INFO: `/v3/projects/337fe1eeeb1f4bd784ae8a091dbc336c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.580350 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] RBAC: Authorizing `identity:delete_project(project_id=337fe1eeeb1f4bd784ae8a091dbc336c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:07.581975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:07.582846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:07.583986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.584546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.584985 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] PATH_INFO: `/v3/projects/2597f2ae0d014e189fe88632add4b751` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.586735 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2597f2ae0d014e189fe88632add4b751)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:07.588749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:07.644594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:07.656253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337fe1eeeb1f4bd784ae8a091dbc336c', 'request_id': 'req-46628433-8789-45ef-96f7-1aa5e429525b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.661910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2597f2ae0d014e189fe88632add4b751', 'request_id': 'req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.665943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337fe1eeeb1f4bd784ae8a091dbc336c', 'request_id': 'req-46628433-8789-45ef-96f7-1aa5e429525b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.674345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337fe1eeeb1f4bd784ae8a091dbc336c', 'request_id': 'req-46628433-8789-45ef-96f7-1aa5e429525b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.679554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2597f2ae0d014e189fe88632add4b751', 'request_id': 'req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.687664 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2597f2ae0d014e189fe88632add4b751', 'request_id': 'req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.694691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] The token cache is being invalidate because project 337fe1eeeb1f4bd784ae8a091dbc336c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:07.694988 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.695752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.698061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1324/2634] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:07 2022] DELETE /identity/v3/projects/337fe1eeeb1f4bd784ae8a091dbc336c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:07.701774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] The token cache is being invalidate because project 2597f2ae0d014e189fe88632add4b751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:07.701940 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:07.702057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.702905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-adb6b0a9-2d3c-4f2e-94ab-8a4913ae4c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.703352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.704731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1311/2635] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:07 2022] DELETE /identity/v3/projects/2597f2ae0d014e189fe88632add4b751 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:07.710238 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8cb1b-8e8d-4761-8284-7ed11dd555aa None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.710577 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8cb1b-8e8d-4761-8284-7ed11dd555aa None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.710865 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8cb1b-8e8d-4761-8284-7ed11dd555aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.732991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-fad8cb1b-8e8d-4761-8284-7ed11dd555aa None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:07.734946 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fad8cb1b-8e8d-4761-8284-7ed11dd555aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.776760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46628433-8789-45ef-96f7-1aa5e429525b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:07.805502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1312/2636] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:07.813135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.813438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.813723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.832011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:07.834046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.842458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1313/2637] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:07.843326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:07.845407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.845775 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.846224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] PATH_INFO: `/v3/users/5e4d2073a2074bf9bb6b2cd4d8a35878` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.846776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:07.847667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4d2073a2074bf9bb6b2cd4d8a35878)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:07.851130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:07.853737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:07.858231 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aecc51-179a-4cc4-a698-4fdef97e007c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:07.865693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:07.866642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.866930 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.867212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.867955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:07.868267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:07.869875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:07.882623 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1314/2638] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:53:07.886780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:07.901912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6546e2-359d-4c96-96a7-5f11c20b49e8 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:07.907192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:07.907854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:07.908143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:07.908421 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:07.909119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:07.912032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:07.917718 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4d2073a2074bf9bb6b2cd4d8a35878'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.936477 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4d2073a2074bf9bb6b2cd4d8a35878'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.937375 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4d2073a2074bf9bb6b2cd4d8a35878'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.938163 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4d2073a2074bf9bb6b2cd4d8a35878'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.942318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1315/2639] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:07 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:07.947010 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:07.948444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4d2073a2074bf9bb6b2cd4d8a35878'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:07.949155 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:07.951089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:07.965345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1325/2640] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:07 2022] DELETE /identity/v3/users/5e4d2073a2074bf9bb6b2cd4d8a35878 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:08.053219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bffc97-54d8-41a6-b7e0-a8ef05b085bd admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.148953 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.149794 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.150234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.150596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.151523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.153763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.183119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1316/2641] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:07 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:08.187950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.202520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d59666-a241-4978-8a87-39658aada862 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.207827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.208693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.209081 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.210309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.211119 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.213285 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.227447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1326/2642] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:08.231936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.248528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb13db-6b2d-4bad-9d8e-8dc2055d22d1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.254938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.255630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.256386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.256386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.257169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.258822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.271108 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1317/2643] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:08.275457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.285733 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1b8a4-a60a-40ed-8913-6ee4df6100b1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.292111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ef0b-788d-4813-a4ef-8413b98b7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.293156 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ef0b-788d-4813-a4ef-8413b98b7a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.293608 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ef0b-788d-4813-a4ef-8413b98b7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.293894 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ef0b-788d-4813-a4ef-8413b98b7a20 admin admin] PATH_INFO: `/v3/projects/2ab1bb95b4c6462284171c967d13a581/users/74263e13035f4eb7a74ebefb1b644927/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.313244 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ef0b-788d-4813-a4ef-8413b98b7a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab1bb95b4c6462284171c967d13a581, user_id=74263e13035f4eb7a74ebefb1b644927, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.316053 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ef0b-788d-4813-a4ef-8413b98b7a20 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.319043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.320958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:08.335731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c2d1-5705-4adc-b046-bbf123f85bbb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.335992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1327/2644] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:08 2022] PUT /identity/v3/projects/2ab1bb95b4c6462284171c967d13a581/users/74263e13035f4eb7a74ebefb1b644927/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:08.347621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.348684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.349158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.383929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] MFA Rules not processed for user `74263e13035f4eb7a74ebefb1b644927`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:08.385197 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:08.407082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:08.417883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.418980 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.419338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.419669 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] PATH_INFO: `/v3/projects/cbe4bec64ab44fd887ee4cc502a91cc8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.422133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe4bec64ab44fd887ee4cc502a91cc8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.424102 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.471674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1328/2645] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:08.477633 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.488369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe4bec64ab44fd887ee4cc502a91cc8', 'request_id': 'req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:08.489922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1841-dee9-489e-b7e0-c807340dc575 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.497176 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe4bec64ab44fd887ee4cc502a91cc8', 'request_id': 'req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:08.503815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe4bec64ab44fd887ee4cc502a91cc8', 'request_id': 'req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:08.515978 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] The token cache is being invalidate because project cbe4bec64ab44fd887ee4cc502a91cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:08.516273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:08.516964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-9a23a8d4-4655-4ca4-b2f0-32d33040c7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:08.518663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1318/2646] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:08 2022] DELETE /identity/v3/projects/cbe4bec64ab44fd887ee4cc502a91cc8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:08.524888 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74857a3-6a14-418e-a287-375276782046 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.525118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74857a3-6a14-418e-a287-375276782046 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.525468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74857a3-6a14-418e-a287-375276782046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.544249 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-e74857a3-6a14-418e-a287-375276782046 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:08.545365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e74857a3-6a14-418e-a287-375276782046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:08.556641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.557366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.557645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.557925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.558788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.560593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.591870 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1329/2647] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:08.592843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.594864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:08.612490 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1319/2648] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:08.620782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.621177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.621524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.633835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:08.640546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:08.641820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:08.666867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dc355-60b4-4511-863e-08e83cac05d8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.671673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.672345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.672628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.672903 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.673593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.675677 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.707521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1330/2649] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:08.711759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.721385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18389e5-4f01-49c8-b9bd-13824c99c9c3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.722083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1320/2650] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:08.726220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.726415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.726901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.727184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.727458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.728183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.729764 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.735372 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f259c0b-718e-4cbd-b40a-be1ed71d3b95 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.740522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1331/2651] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:08.741039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.741701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.741991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.742278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.743045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:08.743362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.744517 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.745250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.754126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3f85-3d5d-4900-8e15-daefff0a5326 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.761012 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1321/2652] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:53:08.761993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.763460 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.764416 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.764707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.764991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] PATH_INFO: `/v3/projects/47515962207a4edfb44f91f7aad80482/users/a0e08e4517b548898f5ae5c571913505/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.772036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66ffcc-02c8-42db-8d4e-1ce46f5e5ff1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.776965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.777601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.777887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.778190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.778900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.780383 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47515962207a4edfb44f91f7aad80482, user_id=a0e08e4517b548898f5ae5c571913505, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.780841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.783080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.792192 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:08.797384 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1332/2653] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:08 2022] PUT /identity/v3/projects/47515962207a4edfb44f91f7aad80482/users/a0e08e4517b548898f5ae5c571913505/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:08.801952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.813808 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1322/2654] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:08.814738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.868366 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6acf44-86f3-4763-bc1c-1cee48003419 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.877445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d96ca-06d1-4e60-afc7-a7e98e796368 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.882384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.883142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.883434 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.883720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.884424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.886371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.907291 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1323/2655] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:08.912158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.921901 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fd48c-f848-42d2-baa2-ed05d783477e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.927190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.927958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.928253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.928540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.929263 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.930848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.930996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.931515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.931802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.932126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.932858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.934468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.945306 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1324/2656] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:08.946402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1333/2657] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:08.946582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.950124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.956265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30937-bee7-4f0d-b99f-6ea8c3bfc8a5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.960886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33488-d62a-449e-8893-16ab6948b92d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.961450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.962124 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.962443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.962724 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.963440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.965028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.965747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e241f8-8721-4daf-8dc9-784ef61726c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:08.966643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e241f8-8721-4daf-8dc9-784ef61726c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.966923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e241f8-8721-4daf-8dc9-784ef61726c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.967210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e241f8-8721-4daf-8dc9-784ef61726c2 admin admin] PATH_INFO: `/v3/projects/47515962207a4edfb44f91f7aad80482/users/a0e08e4517b548898f5ae5c571913505/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:08.969186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e241f8-8721-4daf-8dc9-784ef61726c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47515962207a4edfb44f91f7aad80482, user_id=a0e08e4517b548898f5ae5c571913505, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:08.971868 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e241f8-8721-4daf-8dc9-784ef61726c2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:08.977118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1325/2658] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:08.981320 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:08.984013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1334/2659] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:08 2022] PUT /identity/v3/projects/47515962207a4edfb44f91f7aad80482/users/a0e08e4517b548898f5ae5c571913505/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:08.993129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934507-6a5b-4f80-8f2a-cc64a4af4bae admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:08.994693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:08.994993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:08.995277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.039877 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] MFA Rules not processed for user `a0e08e4517b548898f5ae5c571913505`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:09.041048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.046506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:09.069862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14486479-cf0e-40a3-b600-1ffe09fa24e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.070342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486479-cf0e-40a3-b600-1ffe09fa24e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.070656 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486479-cf0e-40a3-b600-1ffe09fa24e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.070931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486479-cf0e-40a3-b600-1ffe09fa24e7 admin admin] PATH_INFO: `/v3/projects/d5bb14b67a2e4f3f9bbac74cb2235607/users/ac1ae971d1c54fa3a76ba785be0c1440/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.086738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14486479-cf0e-40a3-b600-1ffe09fa24e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bb14b67a2e4f3f9bbac74cb2235607, user_id=ac1ae971d1c54fa3a76ba785be0c1440, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.089433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14486479-cf0e-40a3-b600-1ffe09fa24e7 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.103390 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1326/2660] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:08 2022] PUT /identity/v3/projects/d5bb14b67a2e4f3f9bbac74cb2235607/users/ac1ae971d1c54fa3a76ba785be0c1440/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:09.114180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.114698 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.114995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.118986 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1335/2661] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:09.130905 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.132314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.142870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] MFA Rules not processed for user `ac1ae971d1c54fa3a76ba785be0c1440`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:09.144141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.176916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:09.193116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e692ce2-a8df-4727-8436-ee580c3197b0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.214746 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1327/2662] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:09.219326 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.242420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.243077 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.243367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.243651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.283720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9d60-dc2a-450b-ba8b-32bc4e8fa93e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.289519 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.290182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.290495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.290777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.291471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.293639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.304998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.306469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.316629 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1336/2663] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:53:09.319638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1328/2664] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:09 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:09.323707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.339399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c070-5a20-494e-8fb1-822e93bb47cb service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.340711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:09.404142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.404952 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.405282 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.405802 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.406698 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.409066 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.434011 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1337/2665] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:09 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:09.438024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.449502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931e8c-476a-46bc-8a98-f33de9a5277d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.454447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.461289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.462821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.463416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.464025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.465025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.466316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e08e4a-66a0-47ce-8e3f-9bed8d554194 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.467383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.472247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.472380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.472577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.472856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] PATH_INFO: `/v3/users/74263e13035f4eb7a74ebefb1b644927` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.475320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74263e13035f4eb7a74ebefb1b644927)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.477248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.493168 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1329/2666] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:09.494417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.507678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a48529-efcc-4f98-913f-5de6d8ab9fc1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.514134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.515509 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.515718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.516011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] PATH_INFO: `/v3/projects/f843316f14e5419e8c8cd3017506345d/users/004ba6f133224bfabc25660b9f04f94a/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.532679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74263e13035f4eb7a74ebefb1b644927'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:09.539348 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f843316f14e5419e8c8cd3017506345d, user_id=004ba6f133224bfabc25660b9f04f94a, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.542570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.549352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74263e13035f4eb7a74ebefb1b644927'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:09.550055 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74263e13035f4eb7a74ebefb1b644927'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:09.550746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74263e13035f4eb7a74ebefb1b644927'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:09.558736 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7cec42fe-0b6a-45ba-ba39-e40535661db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74263e13035f4eb7a74ebefb1b644927'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:09.560835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1330/2667] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:09 2022] PUT /identity/v3/projects/f843316f14e5419e8c8cd3017506345d/users/004ba6f133224bfabc25660b9f04f94a/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:09.564526 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.566417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.574955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1338/2668] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:09 2022] DELETE /identity/v3/users/74263e13035f4eb7a74ebefb1b644927 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:09.579357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.579755 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.579923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.598666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:09.600130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.641822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d80113-4944-47d8-82f2-6bf757a92015 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.671877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:09.679473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1339/2669] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:09.690306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.692569 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.709090 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:09.715759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.717037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.717037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.717037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.718129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.720159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.733119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1331/2670] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:09.737260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.750418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90378ce1-e5ed-4f26-b4a7-518bf02a55ca admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.760116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b764f0c-92e7-47f8-92fd-3615380b0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.761072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b764f0c-92e7-47f8-92fd-3615380b0ece admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.761361 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b764f0c-92e7-47f8-92fd-3615380b0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.761679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b764f0c-92e7-47f8-92fd-3615380b0ece admin admin] PATH_INFO: `/v3/projects/f843316f14e5419e8c8cd3017506345d/users/004ba6f133224bfabc25660b9f04f94a/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.763665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b764f0c-92e7-47f8-92fd-3615380b0ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=f843316f14e5419e8c8cd3017506345d, user_id=004ba6f133224bfabc25660b9f04f94a, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.766405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b764f0c-92e7-47f8-92fd-3615380b0ece admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.768025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0c8f-828e-47f0-a13e-2d2b363aee87 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.774473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.775439 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.775863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.776216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.779437 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1332/2671] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:09 2022] PUT /identity/v3/projects/f843316f14e5419e8c8cd3017506345d/users/004ba6f133224bfabc25660b9f04f94a/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:09.790285 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.790581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.791025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.791025 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.792438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.810061 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1340/2672] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:53:09.826560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] MFA Rules not processed for user `004ba6f133224bfabc25660b9f04f94a`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:09.828208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.873461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.875147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.891890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0248309-81dc-4c05-aac5-9c18590a22e4 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:09.911586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1333/2673] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:09.924301 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:09.926840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:09.959895 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:09.960934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:09.961302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:09.961663 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] PATH_INFO: `/v3/users/429fc8cb06f4442abd93eac8354b35c9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:09.963023 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429fc8cb06f4442abd93eac8354b35c9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:09.965026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:09.995952 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafdc02-9d85-449b-8760-cd3326f04b13 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.000657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc18b8-ec30-440e-aaf0-4003c27ba599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:10.001587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc18b8-ec30-440e-aaf0-4003c27ba599 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.001879 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc18b8-ec30-440e-aaf0-4003c27ba599 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.002312 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc18b8-ec30-440e-aaf0-4003c27ba599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.015212 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc18b8-ec30-440e-aaf0-4003c27ba599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:10.016804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc18b8-ec30-440e-aaf0-4003c27ba599 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:10.024158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429fc8cb06f4442abd93eac8354b35c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.029169 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1334/2674] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:53:10.037484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429fc8cb06f4442abd93eac8354b35c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.038325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429fc8cb06f4442abd93eac8354b35c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.039174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429fc8cb06f4442abd93eac8354b35c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.047491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429fc8cb06f4442abd93eac8354b35c9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.064131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1341/2675] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:09 2022] DELETE /identity/v3/users/429fc8cb06f4442abd93eac8354b35c9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:10.069031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.069330 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.069622 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.088899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:10.090130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.128826 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.130753 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.148057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:10.184342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1335/2676] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:10.187032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:10.195446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.197093 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.221780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b52da-c22a-42f8-9cf2-9bc285702903 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.232392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:10.233490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.233789 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.234073 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] PATH_INFO: `/v3/projects/2ab1bb95b4c6462284171c967d13a581` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.235497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab1bb95b4c6462284171c967d13a581)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:10.238976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:10.266996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b613fc-e55b-40ed-bfcb-250730e7b41c None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.271793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:10.272841 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.273185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.273420 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.287394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:10.289082 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:10.300646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1336/2677] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:10.303515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab1bb95b4c6462284171c967d13a581', 'request_id': 'req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.309321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab1bb95b4c6462284171c967d13a581', 'request_id': 'req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.316098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab1bb95b4c6462284171c967d13a581', 'request_id': 'req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.331502 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] The token cache is being invalidate because project 2ab1bb95b4c6462284171c967d13a581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:10.331809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.333509 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.335172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1342/2678] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:10 2022] DELETE /identity/v3/projects/2ab1bb95b4c6462284171c967d13a581 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:10.339270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.349680 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7df99-1c34-43f7-b21e-98f129f12e3e service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.432900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:10.433892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.434276 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.434965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] PATH_INFO: `/v3/users/a0e08e4517b548898f5ae5c571913505` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.436153 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e08e4517b548898f5ae5c571913505)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:10.437988 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:10.517087 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e08e4517b548898f5ae5c571913505'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.517862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e08e4517b548898f5ae5c571913505'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.526600 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e08e4517b548898f5ae5c571913505'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.527323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e08e4517b548898f5ae5c571913505'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.539110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e08e4517b548898f5ae5c571913505'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.562918 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1337/2679] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:10 2022] DELETE /identity/v3/users/a0e08e4517b548898f5ae5c571913505 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:10.640044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.641581 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.663955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11deb2-f1f6-4a9f-bbfd-3e70269b55fb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.737567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.739791 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.743259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:10.744184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.744611 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.744902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] PATH_INFO: `/v3/projects/b7f0ad7c04714e62be42fc1ded635420` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.746142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f0ad7c04714e62be42fc1ded635420)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:10.748298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:10.748639 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:10.756177 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa247e0-42b2-4508-aa8f-26db4a405ff6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.762971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:10.763933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.764574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.765141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] PATH_INFO: `/v3/users/ac1ae971d1c54fa3a76ba785be0c1440` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.767166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1ae971d1c54fa3a76ba785be0c1440)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:10.769147 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:10.817049 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f0ad7c04714e62be42fc1ded635420', 'request_id': 'req-491dd59b-c19a-4134-a7f2-2f080cd751fe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.823345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f0ad7c04714e62be42fc1ded635420', 'request_id': 'req-491dd59b-c19a-4134-a7f2-2f080cd751fe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.830605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1ae971d1c54fa3a76ba785be0c1440'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.830993 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f0ad7c04714e62be42fc1ded635420', 'request_id': 'req-491dd59b-c19a-4134-a7f2-2f080cd751fe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.831513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1ae971d1c54fa3a76ba785be0c1440'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.834499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:10.841207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1ae971d1c54fa3a76ba785be0c1440'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.841957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1ae971d1c54fa3a76ba785be0c1440'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.850172 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] The token cache is being invalidate because project b7f0ad7c04714e62be42fc1ded635420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:10.850596 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.851302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.853642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1343/2680] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:10 2022] DELETE /identity/v3/projects/b7f0ad7c04714e62be42fc1ded635420 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:10.857116 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-a7bcfd0f-1222-4cb5-a1df-77ea71c55bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1ae971d1c54fa3a76ba785be0c1440'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:10.857632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.859293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.882446 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1338/2681] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:10 2022] DELETE /identity/v3/users/ac1ae971d1c54fa3a76ba785be0c1440 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:10.886247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:10.886578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:10.886869 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:10.907456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:10.908954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:10.938647 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd59b-c19a-4134-a7f2-2f080cd751fe admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:10.990000 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1339/2682] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:10.990830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:10.992262 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.006032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed733a-48da-42b5-aa32-0423b007d8de None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.011189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.012313 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.012673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.013036 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] PATH_INFO: `/v3/projects/47515962207a4edfb44f91f7aad80482` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.014292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47515962207a4edfb44f91f7aad80482)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.015329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.016216 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.016342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.016499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.016774 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] PATH_INFO: `/v3/users/85c391ff697c4f5aadcbbde4be0f45e4` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.017984 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c391ff697c4f5aadcbbde4be0f45e4)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.019958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.064597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47515962207a4edfb44f91f7aad80482', 'request_id': 'req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.068909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c391ff697c4f5aadcbbde4be0f45e4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.072863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47515962207a4edfb44f91f7aad80482', 'request_id': 'req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.079386 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47515962207a4edfb44f91f7aad80482', 'request_id': 'req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.081273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c391ff697c4f5aadcbbde4be0f45e4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.082091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c391ff697c4f5aadcbbde4be0f45e4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.083767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c391ff697c4f5aadcbbde4be0f45e4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.086603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:11.090674 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] The token cache is being invalidate because project 47515962207a4edfb44f91f7aad80482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:11.091009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c9e9e5ad-025e-456a-bce5-2564f7e4af2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c391ff697c4f5aadcbbde4be0f45e4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.091135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.091820 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.095321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1340/2683] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:10 2022] DELETE /identity/v3/projects/47515962207a4edfb44f91f7aad80482 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:11.096156 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.097663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.106923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1344/2684] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:10 2022] DELETE /identity/v3/users/85c391ff697c4f5aadcbbde4be0f45e4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:11.108260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd4e8d-77a1-4b5c-920a-5cbddaffc75a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.108553 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd4e8d-77a1-4b5c-920a-5cbddaffc75a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.108830 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd4e8d-77a1-4b5c-920a-5cbddaffc75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.127747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f6dd4e8d-77a1-4b5c-920a-5cbddaffc75a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:11.129030 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f6dd4e8d-77a1-4b5c-920a-5cbddaffc75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.143342 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:11.173477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dc19-d0f7-49f5-b6b0-0ae8b0f66f4d admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.203938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1345/2685] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:11.213250 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.213635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.214033 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.233496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:11.234756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.247047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1346/2686] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:11.248110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.250997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.251657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.251948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.252245 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.254075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.259303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efe13b-f1c4-4a24-aa17-a077c11c9c18 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.264253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.265394 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.265863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.266269 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.267138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:11.267604 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.269324 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.275799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.277235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.284873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1347/2687] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:11.288958 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1341/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:11.291145 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.301571 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29285d-4fae-415c-985d-929d625e8eb2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.307325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.307584 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.307871 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.308155 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.309111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.311158 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.343885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1348/2689] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:11.345042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.357195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07946a-e399-4fcc-8be6-d3d530aea33a service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.412443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.414908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.439878 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.440651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.441541 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.442677 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.443843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.446023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.480589 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1342/2690] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:11.485398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.496403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc8fb-9c75-4907-a1b8-a28b90a42bc6 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.501678 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.502481 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.502700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.503433 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.504352 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.506174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.518416 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1343/2691] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:11.522772 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.529659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ad56-864e-4663-aacf-3d4f26dad6b0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.534295 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a8ff-78c4-4602-8e33-0e24cedd0710 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.540356 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.541122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.541483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.542201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.542929 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.544709 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.545762 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.546684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.547245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.547245 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] PATH_INFO: `/v3/projects/8d9f6b714fc94cda8af05e4f93fa8573` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.548613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9f6b714fc94cda8af05e4f93fa8573)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.550873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.561890 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1344/2692] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:11.562971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.576389 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33aef-380a-42ed-a5f7-5ccf6e285b5e admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.581948 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73c2a1-5cb4-4150-95b3-8625fada76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.583517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73c2a1-5cb4-4150-95b3-8625fada76ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.583720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73c2a1-5cb4-4150-95b3-8625fada76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.584086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73c2a1-5cb4-4150-95b3-8625fada76ad admin admin] PATH_INFO: `/v3/projects/628680bdad9c4d2ebcb019bb40053ccc/users/7edc2b1d056341aaa31751f77cd03a2c/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.601699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73c2a1-5cb4-4150-95b3-8625fada76ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=628680bdad9c4d2ebcb019bb40053ccc, user_id=7edc2b1d056341aaa31751f77cd03a2c, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.604527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73c2a1-5cb4-4150-95b3-8625fada76ad admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.606933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9f6b714fc94cda8af05e4f93fa8573', 'request_id': 'req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.615465 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9f6b714fc94cda8af05e4f93fa8573', 'request_id': 'req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.616666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:11.622690 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1345/2693] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:11 2022] PUT /identity/v3/projects/628680bdad9c4d2ebcb019bb40053ccc/users/7edc2b1d056341aaa31751f77cd03a2c/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:11.627266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9f6b714fc94cda8af05e4f93fa8573', 'request_id': 'req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.628243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.628655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.629117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.645516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] The token cache is being invalidate because project 8d9f6b714fc94cda8af05e4f93fa8573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:11.646400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.647201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7b1ea7fc-22a1-4b9a-b863-e8714d3ed74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.649083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1349/2694] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:11 2022] DELETE /identity/v3/projects/8d9f6b714fc94cda8af05e4f93fa8573 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:11.652505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:11.653521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.653740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.653858 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.654085 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.675700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:11.680040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.688205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:11.757965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1346/2695] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:11.758994 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.760454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.770819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1350/2696] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:11.771563 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.773491 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fedd3-a8f8-47a4-b6ed-81dcfbba9004 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.775522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.778825 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.780219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.780219 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.780654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] PATH_INFO: `/v3/projects/d5bb14b67a2e4f3f9bbac74cb2235607` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.782094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5bb14b67a2e4f3f9bbac74cb2235607)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.784260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:11.841759 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bb14b67a2e4f3f9bbac74cb2235607', 'request_id': 'req-877e3eb2-6038-4519-ad2c-fbee71cc7b10'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.850558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bb14b67a2e4f3f9bbac74cb2235607', 'request_id': 'req-877e3eb2-6038-4519-ad2c-fbee71cc7b10'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.851880 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262dac2-021f-44f8-b1e6-749b9a6ade6a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.857601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bb14b67a2e4f3f9bbac74cb2235607', 'request_id': 'req-877e3eb2-6038-4519-ad2c-fbee71cc7b10'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.869143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] The token cache is being invalidate because project d5bb14b67a2e4f3f9bbac74cb2235607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:11.869347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.870178 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-877e3eb2-6038-4519-ad2c-fbee71cc7b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:11.874412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1347/2697] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:11 2022] DELETE /identity/v3/projects/d5bb14b67a2e4f3f9bbac74cb2235607 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:11.874412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.874412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.874412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.893451 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:11.895061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.911181 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.912167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.912605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.913034 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.915207 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.964201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1348/2698] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:11.964912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:11.966224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:11.979292 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43d42-5fde-4ed2-89a4-f5830ac15eac None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:11.986195 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:11.986581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:11.986870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:11.987152 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] PATH_INFO: `/v3/users/004ba6f133224bfabc25660b9f04f94a` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:11.988375 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=004ba6f133224bfabc25660b9f04f94a)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:11.990580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.001491 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.003037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.015257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:12.018783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1351/2699] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:12.027938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.046998 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565342e5-bef4-4e72-9200-f195da04cbfb service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.056472 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.057295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.057937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004ba6f133224bfabc25660b9f04f94a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.058389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.058704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004ba6f133224bfabc25660b9f04f94a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.058851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.059529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:12.059960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.061714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.066693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004ba6f133224bfabc25660b9f04f94a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.067659 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004ba6f133224bfabc25660b9f04f94a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.076021 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1352/2700] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:12.079088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004ba6f133224bfabc25660b9f04f94a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.080631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.084112 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:12.094591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:12.102684 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2f390-941c-4c90-847a-1a98233a680f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.108119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1349/2701] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:11 2022] DELETE /identity/v3/users/004ba6f133224bfabc25660b9f04f94a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:12.110916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.111827 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.112177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.112523 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.113479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.116062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.149507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1353/2702] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:12.151006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.228403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1b8ae-c638-4d48-b6ab-0c601ac407fb admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.293764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.294476 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.294800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.295099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.295805 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.297749 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.319546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1350/2703] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:12.323577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.334852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890b6e-59d3-4e8e-8ce4-26dc126d8a59 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.340221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.340883 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.341166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.341708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.342252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.343926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.357413 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1354/2704] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:12.358701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.369603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe9fe-5c08-4c09-bbb6-844d43a93602 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.374912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdc67a-d67f-45c6-9151-ac99d7b1f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.375613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdc67a-d67f-45c6-9151-ac99d7b1f014 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.375900 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdc67a-d67f-45c6-9151-ac99d7b1f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.376184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdc67a-d67f-45c6-9151-ac99d7b1f014 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.376915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdc67a-d67f-45c6-9151-ac99d7b1f014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.378545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdc67a-d67f-45c6-9151-ac99d7b1f014 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.390297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1351/2705] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:12.394243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.408936 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4c5a6-1411-49fa-a6fd-5d5cbbcd5bd0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.414418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.415316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.415593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.415865 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] PATH_INFO: `/v3/projects/789ee013724e4502a4b10ad93c1a8151/users/4a41f5afa471496ca4c6991d7e3516a3/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.448873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ee013724e4502a4b10ad93c1a8151, user_id=4a41f5afa471496ca4c6991d7e3516a3, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.452003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.472498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1355/2706] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:12 2022] PUT /identity/v3/projects/789ee013724e4502a4b10ad93c1a8151/users/4a41f5afa471496ca4c6991d7e3516a3/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:12.483299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de353561-1d87-49a1-8899-ab9993713bda None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.484138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de353561-1d87-49a1-8899-ab9993713bda None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.484418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de353561-1d87-49a1-8899-ab9993713bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.515365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-de353561-1d87-49a1-8899-ab9993713bda None None] MFA Rules not processed for user `4a41f5afa471496ca4c6991d7e3516a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:12.516863 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-de353561-1d87-49a1-8899-ab9993713bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:12.528492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:12.595954 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1352/2707] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:12.601283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.692486 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a756b-62c9-4078-9eea-e27c23967028 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.698934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.699660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.699949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.700232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.700929 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.702951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.708417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de353561-1d87-49a1-8899-ab9993713bda None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.709845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-de353561-1d87-49a1-8899-ab9993713bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:12.727310 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de353561-1d87-49a1-8899-ab9993713bda None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.732604 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.733483 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.733775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.734063 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] PATH_INFO: `/v3/projects/f843316f14e5419e8c8cd3017506345d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.735497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f843316f14e5419e8c8cd3017506345d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.737478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.755174 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1356/2708] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:12.758226 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.803723 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f843316f14e5419e8c8cd3017506345d', 'request_id': 'req-c284cdb5-0adc-424d-8128-11fd4bde639a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.813775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f843316f14e5419e8c8cd3017506345d', 'request_id': 'req-c284cdb5-0adc-424d-8128-11fd4bde639a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.823351 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f843316f14e5419e8c8cd3017506345d', 'request_id': 'req-c284cdb5-0adc-424d-8128-11fd4bde639a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.834228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e152587-8a09-4449-920b-93145fc14445 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.834991 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] The token cache is being invalidate because project f843316f14e5419e8c8cd3017506345d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:12.835364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.836106 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c284cdb5-0adc-424d-8128-11fd4bde639a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:12.838126 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1353/2709] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:12 2022] DELETE /identity/v3/projects/f843316f14e5419e8c8cd3017506345d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:12.843057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.843507 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.843801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.865258 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:12.866539 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:12.877760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:12.914788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a0033-cfc3-4e68-8338-cf3f78e03762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.915622 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a0033-cfc3-4e68-8338-cf3f78e03762 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.916040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a0033-cfc3-4e68-8338-cf3f78e03762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.916393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a0033-cfc3-4e68-8338-cf3f78e03762 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.920881 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a0033-cfc3-4e68-8338-cf3f78e03762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.923552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a0033-cfc3-4e68-8338-cf3f78e03762 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:12.947739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1357/2710] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:12.949347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.949813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.951401 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.968672 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1354/2711] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:12.969799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:12.971211 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:12.984547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3c386-8b35-422f-9e30-1192f2acff75 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:12.987606 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] MFA Rules not processed for user `7edc2b1d056341aaa31751f77cd03a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:12.990467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:12.990840 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8711-ead2-4829-a340-7616eb3d6f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:12.991513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8711-ead2-4829-a340-7616eb3d6f0f admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:12.991793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8711-ead2-4829-a340-7616eb3d6f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:12.992071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8711-ead2-4829-a340-7616eb3d6f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:12.992801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8711-ead2-4829-a340-7616eb3d6f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:12.994417 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8711-ead2-4829-a340-7616eb3d6f0f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.008457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1355/2712] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:13.010060 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.010528 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.010928 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.036362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:13.037513 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:13.046753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1356/2713] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:13.050630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.061853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14db1-9b0b-4056-aab4-8f77d9200ca2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.066768 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.068341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.068713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.069072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] PATH_INFO: `/v3/projects/cc1f2fce432249cd819012885e5db5c6/users/f3f84638e7ba4ce381a498f10ce425ab/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.078351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1358/2714] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:13.079228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.088439 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1f2fce432249cd819012885e5db5c6, user_id=f3f84638e7ba4ce381a498f10ce425ab, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.089955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547fb16-2379-4d5c-9a9c-a52d30564aad None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.091429 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.093858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:13.096362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.097235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.097590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.099003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.099892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:13.100214 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.102036 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.109017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1357/2715] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:13 2022] PUT /identity/v3/projects/cc1f2fce432249cd819012885e5db5c6/users/f3f84638e7ba4ce381a498f10ce425ab/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:13.112034 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.112218 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:13.119071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1359/2716] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:13.119071 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.131591 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2af9-3c47-46ad-9827-8e3bad046a23 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.173075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578481-fdce-4ccd-a5be-655c1b3f4795 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.178371 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.179042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.179335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.179641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.192947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.193839 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.194128 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.194444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.195175 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.196795 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.206693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1360/2717] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:13.207689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.217213 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ef29c-0fc2-4c78-8d42-d195f7cc8ae0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.222045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.222727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.223062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.223344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.224028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.225910 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.237830 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.239939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.249117 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1358/2718] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:13.249969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.256072 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1361/2719] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:13.257427 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.263197 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e04d-d438-4cfb-8fff-f650c382496d service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.279511 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:13.328867 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af87372-3910-482c-b6c2-e92991339427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.329790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af87372-3910-482c-b6c2-e92991339427 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.330067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af87372-3910-482c-b6c2-e92991339427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.330347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af87372-3910-482c-b6c2-e92991339427 admin admin] PATH_INFO: `/v3/projects/cc1f2fce432249cd819012885e5db5c6/users/f3f84638e7ba4ce381a498f10ce425ab/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.332428 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af87372-3910-482c-b6c2-e92991339427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1f2fce432249cd819012885e5db5c6, user_id=f3f84638e7ba4ce381a498f10ce425ab, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.335462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af87372-3910-482c-b6c2-e92991339427 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.340525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d4b3-226e-44ce-90be-472c549d5130 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.346119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1359/2720] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:13 2022] PUT /identity/v3/projects/cc1f2fce432249cd819012885e5db5c6/users/f3f84638e7ba4ce381a498f10ce425ab/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:13.357066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.357495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.357797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.387870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] MFA Rules not processed for user `f3f84638e7ba4ce381a498f10ce425ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:13.389346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:13.408533 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.409219 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.409508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.409803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.411771 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.413184 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.429422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:13.448646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1362/2721] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:13.453256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.465612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85058714-f7c7-4b2b-8fd7-84cf531d3740 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.471392 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.472335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.472651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.473689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.474652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.476295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.476811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1360/2722] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:13.491135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1363/2723] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:13.491643 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.491764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.493631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:13.503703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580e70d-2562-466f-a972-7adb78432a96 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.509853 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.510727 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.511089 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.511388 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.512130 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.513704 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.527281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1364/2724] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:13.531655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.552000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7285e-a186-4709-8d27-709e4c90177b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.558555 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.559607 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.559896 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.560818 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] PATH_INFO: `/v3/projects/59c6dbfc01a94b478ac7bd970b27cceb/users/e47e4268b30040ab847b1beac01a8431/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.566566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8aa3-5537-437f-8d46-7fa6d7c6bf58 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.573088 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e91ffd-203b-4021-93b7-e88485762a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.574272 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e91ffd-203b-4021-93b7-e88485762a52 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.575136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e91ffd-203b-4021-93b7-e88485762a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.575615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e91ffd-203b-4021-93b7-e88485762a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.577947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c6dbfc01a94b478ac7bd970b27cceb, user_id=e47e4268b30040ab847b1beac01a8431, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.580906 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.588903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e91ffd-203b-4021-93b7-e88485762a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.590875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e91ffd-203b-4021-93b7-e88485762a52 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.602389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1365/2725] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:13 2022] PUT /identity/v3/projects/59c6dbfc01a94b478ac7bd970b27cceb/users/e47e4268b30040ab847b1beac01a8431/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:13.610574 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1361/2726] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:13.621524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.621818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.622105 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.670456 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] MFA Rules not processed for user `e47e4268b30040ab847b1beac01a8431`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:13.672452 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:13.716760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.753135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1362/2727] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:13.758489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.782921 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9b96-ad39-47f6-a283-1d31bd4df612 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.787096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.787746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.788068 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.788365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.790215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:13.814829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:13.827341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff8eb-edef-4a43-8dfe-0df165d81f7e None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.832851 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.833517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.833921 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.834204 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.834932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.836832 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.840230 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:13.856304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.857748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.864413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1363/2728] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:13.867067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1366/2729] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:13.868427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.932368 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d20b-7d7f-4b25-be65-a5c46f8467ac admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.937492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.938061 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.938498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.938848 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.939505 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.941418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:13.962440 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1364/2730] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:13 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:13.966922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:13.979724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8ac1-35ba-4de9-a3e2-088ed44ccc6b service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:13.984513 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:13.985099 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:13.985917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:13.985917 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:13.986492 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:13.988083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.000686 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1367/2731] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:14.006171 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:14.016254 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af0903-2749-4055-9d4f-98e5b0490301 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:14.021997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:14.023083 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.023365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.023645 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] PATH_INFO: `/v3/projects/01490a769b3f41d7925266457622f374/users/eeb26c21f2c04ab99aa6dcd6f7ff447e/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.039494 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] RBAC: Authorizing `identity:create_grant(project_id=01490a769b3f41d7925266457622f374, user_id=eeb26c21f2c04ab99aa6dcd6f7ff447e, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:14.042504 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.055049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1365/2732] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:14 2022] PUT /identity/v3/projects/01490a769b3f41d7925266457622f374/users/eeb26c21f2c04ab99aa6dcd6f7ff447e/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:14.058992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:14.069833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325183-aa71-4a19-b648-a20fdf5969c0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:14.128728 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203335e6-80d5-4626-8a06-88f2f5f68cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:14.130064 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203335e6-80d5-4626-8a06-88f2f5f68cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.130380 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203335e6-80d5-4626-8a06-88f2f5f68cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.130676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203335e6-80d5-4626-8a06-88f2f5f68cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.131411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203335e6-80d5-4626-8a06-88f2f5f68cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:14.133022 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203335e6-80d5-4626-8a06-88f2f5f68cf5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.142710 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1368/2733] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:14.146972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:14.157266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb434e55-ac90-4666-809d-b9d1a45888db admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:14.162527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:14.163404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.163691 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.163973 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] PATH_INFO: `/v3/projects/01490a769b3f41d7925266457622f374/users/eeb26c21f2c04ab99aa6dcd6f7ff447e/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.165966 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01490a769b3f41d7925266457622f374, user_id=eeb26c21f2c04ab99aa6dcd6f7ff447e, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:14.168893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.179650 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1366/2734] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:14 2022] PUT /identity/v3/projects/01490a769b3f41d7925266457622f374/users/eeb26c21f2c04ab99aa6dcd6f7ff447e/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:14.189651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.189948 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.190240 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.216904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] MFA Rules not processed for user `eeb26c21f2c04ab99aa6dcd6f7ff447e`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:14.218047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:14.288825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1369/2735] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:14.300450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:14.356148 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e7306-0f1c-43bd-af5a-abf3ed02fc2c admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:14.359862 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44796ffc-a365-4be3-8633-e16f5dd41221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:14.360498 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44796ffc-a365-4be3-8633-e16f5dd41221 service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.360788 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44796ffc-a365-4be3-8633-e16f5dd41221 service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.361072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44796ffc-a365-4be3-8633-e16f5dd41221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.370675 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44796ffc-a365-4be3-8633-e16f5dd41221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:14.372114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44796ffc-a365-4be3-8633-e16f5dd41221 service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.381462 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1367/2736] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:14.450177 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:14.460779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259620b-36e6-4562-85be-e3f1782205ab None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:14.464447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:14.465087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.465372 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.465649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.496297 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:14.523588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:14.525048 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.534183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1370/2737] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:14.659917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb42b-e7ca-4e11-bb0e-c823680390b4 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.659917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb42b-e7ca-4e11-bb0e-c823680390b4 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.659917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb42b-e7ca-4e11-bb0e-c823680390b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.677243 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7e3eb42b-e7ca-4e11-bb0e-c823680390b4 None None] MFA Rules not processed for user `7edc2b1d056341aaa31751f77cd03a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:14.678569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e3eb42b-e7ca-4e11-bb0e-c823680390b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:14.715586 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:14.741297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1368/2738] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:14.820437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:14.884253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01365f-063b-4c80-b791-7d262d2299f7 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:14.888873 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:14.889751 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.890041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.890325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] PATH_INFO: `/v3/users/e47e4268b30040ab847b1beac01a8431` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:14.891562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47e4268b30040ab847b1beac01a8431)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:14.893525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:14.941464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47e4268b30040ab847b1beac01a8431'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:14.954625 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47e4268b30040ab847b1beac01a8431'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:14.955327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47e4268b30040ab847b1beac01a8431'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:14.955959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47e4268b30040ab847b1beac01a8431'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:14.962803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47e4268b30040ab847b1beac01a8431'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:14.976943 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1371/2739] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:14 2022] DELETE /identity/v3/users/e47e4268b30040ab847b1beac01a8431 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:14.981250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:14.981682 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:14.981824 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:15.000129 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:15.001381 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:15.086189 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1369/2740] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:15.098767 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:15.100983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:15.168579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696f33-e1f0-464a-a0b5-0b34ce7ef4ad admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:15.172499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:15.173144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:15.173430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:15.173773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:15.180925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:15.184900 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:15.186497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:15.202536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1372/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:15.591961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:15.593910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:15.612823 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec7ca-23a7-4a9d-80c4-d12f5f3f2a71 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:15.619472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:15.620506 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:15.620725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:15.621101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] PATH_INFO: `/v3/projects/59c6dbfc01a94b478ac7bd970b27cceb` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:15.623224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c6dbfc01a94b478ac7bd970b27cceb)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:15.625261 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:15.680753 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c6dbfc01a94b478ac7bd970b27cceb', 'request_id': 'req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.691366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c6dbfc01a94b478ac7bd970b27cceb', 'request_id': 'req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.700086 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c6dbfc01a94b478ac7bd970b27cceb', 'request_id': 'req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.712478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] The token cache is being invalidate because project 59c6dbfc01a94b478ac7bd970b27cceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:15.712874 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.713642 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.715408 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1370/2742] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:15 2022] DELETE /identity/v3/projects/59c6dbfc01a94b478ac7bd970b27cceb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:15.719242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:15.729656 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e929f-96e8-4bc3-a0c7-97dba675e7c7 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:15.789450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:15.790675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:15.790970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:15.791255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] PATH_INFO: `/v3/users/eeb26c21f2c04ab99aa6dcd6f7ff447e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:15.792717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb26c21f2c04ab99aa6dcd6f7ff447e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:15.794703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:15.847309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb26c21f2c04ab99aa6dcd6f7ff447e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.860044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb26c21f2c04ab99aa6dcd6f7ff447e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.860798 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb26c21f2c04ab99aa6dcd6f7ff447e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.861419 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb26c21f2c04ab99aa6dcd6f7ff447e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.868506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-145d85d5-1d16-4bca-a524-8affc0971089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb26c21f2c04ab99aa6dcd6f7ff447e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:15.882320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1373/2743] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:15 2022] DELETE /identity/v3/users/eeb26c21f2c04ab99aa6dcd6f7ff447e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:16.172931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.174523 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:16.187967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934aa8a-2ba0-426e-b8df-8b891bd4fe1b admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.254587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.255441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.255727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.256006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] PATH_INFO: `/v3/projects/01490a769b3f41d7925266457622f374` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.257384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01490a769b3f41d7925266457622f374)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.259609 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.271323 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:16.311318 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01490a769b3f41d7925266457622f374', 'request_id': 'req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:16.319484 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01490a769b3f41d7925266457622f374', 'request_id': 'req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:16.326542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01490a769b3f41d7925266457622f374', 'request_id': 'req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:16.339730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] The token cache is being invalidate because project 01490a769b3f41d7925266457622f374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:16.340032 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:16.340748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-c0dfce95-d0f7-40b5-b005-0d6fed41ef81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:16.342321 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1371/2744] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:16 2022] DELETE /identity/v3/projects/01490a769b3f41d7925266457622f374 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:16.351121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.352018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.352473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.376869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:16.378624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:16.454708 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1374/2745] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:16.464213 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.464730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.465062 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.488303 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:16.489947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:16.503646 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1372/2746] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:16.509147 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.522908 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22c11-2a94-4939-ad4a-e9556fc49205 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.528697 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.528909 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.529203 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.529474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.531045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:16.531045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.532142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.542277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:16.555661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1375/2747] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:16.556939 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.567475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beabb9-23e0-4113-b6a4-ab126d89a0d2 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.573587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.574264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.574599 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.575103 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.575818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.577721 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.609461 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1373/2748] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:16 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:16.614106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.625263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8789e-a4bf-4e69-b26b-84a79953dbd8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.698876 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.699063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.699407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.699815 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.700623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.702735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.730373 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1376/2749] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:16 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:16.731560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.744896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6356-52db-4f64-afd9-97467fa7dae5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.750266 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.751089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.751495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.751782 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.752693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.754581 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.767430 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1374/2750] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:16.771235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.781787 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8ad31-5d3b-47d7-8674-1cde25764d40 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.787291 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5ec41-8262-4798-a0af-99c7c944f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.788087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ec41-8262-4798-a0af-99c7c944f2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.788831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ec41-8262-4798-a0af-99c7c944f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.788831 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ec41-8262-4798-a0af-99c7c944f2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.789784 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5ec41-8262-4798-a0af-99c7c944f2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.792314 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5ec41-8262-4798-a0af-99c7c944f2c8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.805788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1377/2751] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:16.809995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.822279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac906f-e8d1-4314-ae79-5b0572307fc1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:16.831376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:16.832816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.833104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.833358 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] PATH_INFO: `/v3/projects/cf521f7d98c641d4941eb041acf65405/users/674d054767ff4eec993ca7fefdce3967/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.849658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf521f7d98c641d4941eb041acf65405, user_id=674d054767ff4eec993ca7fefdce3967, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:16.852471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:16.866751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1375/2752] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:16 2022] PUT /identity/v3/projects/cf521f7d98c641d4941eb041acf65405/users/674d054767ff4eec993ca7fefdce3967/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:16.872094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:16.872481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:16.872835 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:16.891180 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:16.892485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:16.955113 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1378/2753] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:16.965892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:16.967730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:17.027719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d404b3-d87a-4604-b66b-3bb5e67d42c4 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:17.031441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab778b-d7b1-4b46-a9ea-02de83237a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:17.032109 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab778b-d7b1-4b46-a9ea-02de83237a5e service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:17.032398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab778b-d7b1-4b46-a9ea-02de83237a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:17.032673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab778b-d7b1-4b46-a9ea-02de83237a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:17.044605 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab778b-d7b1-4b46-a9ea-02de83237a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:17.046071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab778b-d7b1-4b46-a9ea-02de83237a5e service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:17.056858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1376/2754] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:21.057852 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:21.060642 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:21.137389 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32e80-44f0-4da3-a91d-62ec5fefff3a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:21.143204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:21.143867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:21.144210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:21.144496 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:21.147458 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:21.185747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:21.233114 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:21.234747 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:21.249028 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1379/2755] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:22.265530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.266043 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.266145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.295943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] MFA Rules not processed for user `674d054767ff4eec993ca7fefdce3967`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:22.297160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:22.325545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:22.367708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1377/2756] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:22.372280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:22.383939 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c227146-3ec5-4cdb-9798-0fa77eaa813d service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:22.388861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:22.389646 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.389933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.390318 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.390933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:22.392845 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:22.423042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1380/2757] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:22 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:22.428056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:22.438750 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0304-8816-4f13-adc5-be3f83e7ee7d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:22.495042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:22.495712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.495996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.496275 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.496961 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:22.498912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:22.518480 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1378/2758] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:22 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:22.522443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:22.533228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6bfa-290f-47aa-bc79-666f48c21895 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:22.538763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:22.539433 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.539724 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.540009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.540808 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:22.542613 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:22.554645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1381/2759] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:22.561885 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:22.572182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211c5dd-1504-4ca1-a1b0-544767cc406f admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:22.576960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:22.577797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.578084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.578392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] PATH_INFO: `/v3/projects/6fbfbb0c816a4176bd9b0c634c1cae77/users/b4538bd7fd344bf5917783f16f5a4165/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.594132 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbfbb0c816a4176bd9b0c634c1cae77, user_id=b4538bd7fd344bf5917783f16f5a4165, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:22.596839 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:22.613141 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1379/2760] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:22 2022] PUT /identity/v3/projects/6fbfbb0c816a4176bd9b0c634c1cae77/users/b4538bd7fd344bf5917783f16f5a4165/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:22.618329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:22.631117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1b1a1-ced7-4118-9c1f-9e8e4a237870 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:22.689925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:22.690640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.690926 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.691206 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.692040 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:22.693637 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:22.703701 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1382/2761] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:22.708403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:22.718673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0d96-7d86-4d4f-8a90-53ddc58288ae admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:22.723967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4b3db-e115-4246-8bdd-5c1da0a6f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:22.724834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4b3db-e115-4246-8bdd-5c1da0a6f4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:22.725115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4b3db-e115-4246-8bdd-5c1da0a6f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:22.725391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4b3db-e115-4246-8bdd-5c1da0a6f4e4 admin admin] PATH_INFO: `/v3/projects/6fbfbb0c816a4176bd9b0c634c1cae77/users/b4538bd7fd344bf5917783f16f5a4165/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:22.727376 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4b3db-e115-4246-8bdd-5c1da0a6f4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbfbb0c816a4176bd9b0c634c1cae77, user_id=b4538bd7fd344bf5917783f16f5a4165, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:22.730024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4b3db-e115-4246-8bdd-5c1da0a6f4e4 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:22.740199 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1380/2762] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:22 2022] PUT /identity/v3/projects/6fbfbb0c816a4176bd9b0c634c1cae77/users/b4538bd7fd344bf5917783f16f5a4165/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:25.548692 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:25.552560 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:25.572520 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8fe64-9723-43ac-ae38-1583f861a146 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:25.702381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:25.705902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:25.706825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:25.708260 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] PATH_INFO: `/v3/users/4a41f5afa471496ca4c6991d7e3516a3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:25.710263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a41f5afa471496ca4c6991d7e3516a3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:25.719283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:25.833296 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:25.851367 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a41f5afa471496ca4c6991d7e3516a3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:25.879536 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a41f5afa471496ca4c6991d7e3516a3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:25.880780 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a41f5afa471496ca4c6991d7e3516a3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:25.881565 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a41f5afa471496ca4c6991d7e3516a3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:25.912345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a41f5afa471496ca4c6991d7e3516a3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:25.941691 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1383/2763] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:25 2022] DELETE /identity/v3/users/4a41f5afa471496ca4c6991d7e3516a3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:25.947936 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:25.948488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:25.948705 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:25.996880 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:26.000404 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:26.145942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1381/2764] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:26.162735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:26.164543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:26.291461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00047d09-2d6b-4339-8e77-f370f45481e2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:26.298668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:26.299760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:26.300215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:26.300651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:26.311965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:26.314275 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:26.327869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1384/2765] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:27.087892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:27.090248 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:27.113114 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee13d1f-ff8d-46c2-9797-a400d9900477 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:27.128122 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:27.130427 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:27.132006 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:27.133855 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] PATH_INFO: `/v3/projects/789ee013724e4502a4b10ad93c1a8151` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:27.136720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789ee013724e4502a4b10ad93c1a8151)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:27.146601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:27.192047 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:27.264617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789ee013724e4502a4b10ad93c1a8151', 'request_id': 'req-4064fa54-ed97-489b-910f-c02227318694'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.274963 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789ee013724e4502a4b10ad93c1a8151', 'request_id': 'req-4064fa54-ed97-489b-910f-c02227318694'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.283607 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789ee013724e4502a4b10ad93c1a8151', 'request_id': 'req-4064fa54-ed97-489b-910f-c02227318694'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.297883 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] The token cache is being invalidate because project 789ee013724e4502a4b10ad93c1a8151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:27.298184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.298938 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.300508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1382/2766] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:27 2022] DELETE /identity/v3/projects/789ee013724e4502a4b10ad93c1a8151 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:27.305012 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:27.329561 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183be9c5-2f6b-4739-8156-04fc89d5c531 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:27.470461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:27.479851 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:27.480164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:27.480444 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] PATH_INFO: `/v3/users/f3f84638e7ba4ce381a498f10ce425ab` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:27.485602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f84638e7ba4ce381a498f10ce425ab)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:27.488117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:27.598305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:27.624417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f84638e7ba4ce381a498f10ce425ab'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.650121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f84638e7ba4ce381a498f10ce425ab'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.653659 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f84638e7ba4ce381a498f10ce425ab'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.654891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f84638e7ba4ce381a498f10ce425ab'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.666777 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5346e7f1-bfb8-4fc2-8577-4ec9ade350a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f84638e7ba4ce381a498f10ce425ab'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:27.709437 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1385/2767] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:27 2022] DELETE /identity/v3/users/f3f84638e7ba4ce381a498f10ce425ab => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:28.395431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:28.398253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:28.443355 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064fa54-ed97-489b-910f-c02227318694 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:28.506752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19afbe-edce-4721-af01-d3b6909396db None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:28.507142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19afbe-edce-4721-af01-d3b6909396db None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:28.507327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19afbe-edce-4721-af01-d3b6909396db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:28.554590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1f19afbe-edce-4721-af01-d3b6909396db None None] MFA Rules not processed for user `ae334c4d93cd4d3e94789a5985fcfa77`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:28.556042 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1f19afbe-edce-4721-af01-d3b6909396db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:28.588982 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:28.589786 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:28.590071 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:28.590349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] PATH_INFO: `/v3/projects/cc1f2fce432249cd819012885e5db5c6` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:28.591818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1f2fce432249cd819012885e5db5c6)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:28.593942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:28.717919 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1f2fce432249cd819012885e5db5c6', 'request_id': 'req-96be832e-e283-4911-850d-107ed16c776f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:28.727492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1f2fce432249cd819012885e5db5c6', 'request_id': 'req-96be832e-e283-4911-850d-107ed16c776f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:28.772317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1f2fce432249cd819012885e5db5c6', 'request_id': 'req-96be832e-e283-4911-850d-107ed16c776f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:28.786499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1386/2768] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:28.824672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:28.824963 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:28.826137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:28.834046 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] The token cache is being invalidate because project cc1f2fce432249cd819012885e5db5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:28.835075 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:28.836029 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-96be832e-e283-4911-850d-107ed16c776f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:28.838524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1383/2769] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:28 2022] DELETE /identity/v3/projects/cc1f2fce432249cd819012885e5db5c6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:28.844133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec48488-c033-4d56-b633-4a672ff90e90 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:28.846031 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec48488-c033-4d56-b633-4a672ff90e90 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:28.846203 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec48488-c033-4d56-b633-4a672ff90e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:28.906396 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0ec48488-c033-4d56-b633-4a672ff90e90 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:28.907645 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] MFA Rules not processed for user `b4538bd7fd344bf5917783f16f5a4165`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:28.910551 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0ec48488-c033-4d56-b633-4a672ff90e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:28.912281 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:29.003795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:29.111964 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1387/2770] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:29.120239 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1384/2771] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:29.127821 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.131378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:29.131854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e9b16-6c24-4622-a570-72002f326531 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.132145 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e9b16-6c24-4622-a570-72002f326531 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.132442 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e9b16-6c24-4622-a570-72002f326531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.164208 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-452e9b16-6c24-4622-a570-72002f326531 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:29.165438 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-452e9b16-6c24-4622-a570-72002f326531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:29.178942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1385/2772] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:29.179964 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e9b16-6c24-4622-a570-72002f326531 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.195035 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e9b16-6c24-4622-a570-72002f326531 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.206568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.207810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.208265 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.208777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.209898 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:29.210222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.211933 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.226768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:29.251460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1386/2773] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:29.258475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.278166 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1669f-1d0e-4f5f-ad73-bf838d20eb72 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.292207 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.292905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.293194 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.293477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.294190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.297979 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.324824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc2e16-fa30-41bf-848b-b7b9f385ba3a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.331744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.332482 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.332759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.333773 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.335705 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:29.338899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1387/2774] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:29 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:29.343579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.424322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.426013 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.437666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b868-1ee2-410e-8d59-e4c5deef5d05 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.440186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1388/2775] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:53:29.444763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.445445 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.445737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.446019 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.446986 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.448801 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.486268 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1388/2776] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:29 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:29.488674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.500498 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab26d2c-2219-444d-afed-b847cfff5c94 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.505599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.506469 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.506759 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.507311 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.507847 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.509529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.525202 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1389/2777] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:29.525714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.537402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9100-7d83-41d1-bd3a-5b1c0f6da228 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.544146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbd555-68b6-4f96-9fae-f26843f6f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.545317 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd555-68b6-4f96-9fae-f26843f6f7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.546024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd555-68b6-4f96-9fae-f26843f6f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.546582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd555-68b6-4f96-9fae-f26843f6f7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.547201 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbd555-68b6-4f96-9fae-f26843f6f7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.549572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbd555-68b6-4f96-9fae-f26843f6f7c5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.561545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1389/2778] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:29.565436 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.576485 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680cf5d-2ee7-413a-9fe5-64c5b6f4312f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.584321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.585236 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.585506 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.585819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] PATH_INFO: `/v3/projects/459c57be8df742f29332c0fb10388444/users/3e356b8a11384f6fb032a6a336b5f9e5/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.604991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459c57be8df742f29332c0fb10388444, user_id=3e356b8a11384f6fb032a6a336b5f9e5, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.608813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.625428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1390/2779] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:29 2022] PUT /identity/v3/projects/459c57be8df742f29332c0fb10388444/users/3e356b8a11384f6fb032a6a336b5f9e5/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:29.636747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.636972 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.637296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.687353 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] MFA Rules not processed for user `3e356b8a11384f6fb032a6a336b5f9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:29.688537 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:29.775066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:29.781780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1390/2780] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:29.785667 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.899294 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae97d4-a9d8-4025-936b-13efd7cacd14 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:29.907567 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:29.908255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:29.908547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:29.908832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:29.909552 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:29.913246 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:29.956779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1391/2781] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:29 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:29.958485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:29.971039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1726-b303-46e6-8288-4158e849f190 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:30.045967 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:30.046934 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.047542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.047943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.048751 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:30.052460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:30.086795 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1391/2782] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:29 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:30.088256 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:30.100981 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6430e-7e9d-4403-8e90-0d14f3fbfde3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:30.106497 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:30.107237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.107630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.108017 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.108885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:30.110674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:30.113315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:30.126409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1392/2783] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:30.129380 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:30.143206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711f843-5458-4bd4-8a91-58bd5e9f2227 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:30.153708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:30.154793 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.155131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.155458 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] PATH_INFO: `/v3/projects/8d1caa0c911f4a03b2812bb033a58a3d/users/3638160ffea04de6b666afed201563cd/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.177475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1caa0c911f4a03b2812bb033a58a3d, user_id=3638160ffea04de6b666afed201563cd, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:30.184425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:30.211084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1392/2784] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:30 2022] PUT /identity/v3/projects/8d1caa0c911f4a03b2812bb033a58a3d/users/3638160ffea04de6b666afed201563cd/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:30.215782 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:30.229974 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570765cd-bf99-41da-8d70-1cf389828192 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:30.328404 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9b88f-bd51-4aec-98e5-4c3dc17e946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:30.329330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b88f-bd51-4aec-98e5-4c3dc17e946a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.329898 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b88f-bd51-4aec-98e5-4c3dc17e946a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.330201 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b88f-bd51-4aec-98e5-4c3dc17e946a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.333387 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b88f-bd51-4aec-98e5-4c3dc17e946a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:30.335673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b88f-bd51-4aec-98e5-4c3dc17e946a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:30.354605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1393/2785] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:30.355916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:30.371695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7b84-a7d3-49c5-ae46-f1bd1fb5ae56 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:30.380595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:30.381892 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.382277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.382708 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] PATH_INFO: `/v3/projects/8d1caa0c911f4a03b2812bb033a58a3d/users/3638160ffea04de6b666afed201563cd/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.385059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1caa0c911f4a03b2812bb033a58a3d, user_id=3638160ffea04de6b666afed201563cd, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:30.388234 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:30.408397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1393/2786] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:30 2022] PUT /identity/v3/projects/8d1caa0c911f4a03b2812bb033a58a3d/users/3638160ffea04de6b666afed201563cd/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:30.420124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec80f9e-7d5d-45c9-8bbe-ade4c1911f70 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.420763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec80f9e-7d5d-45c9-8bbe-ade4c1911f70 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.422185 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec80f9e-7d5d-45c9-8bbe-ade4c1911f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.465471 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4ec80f9e-7d5d-45c9-8bbe-ade4c1911f70 None None] MFA Rules not processed for user `3638160ffea04de6b666afed201563cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:30.467322 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4ec80f9e-7d5d-45c9-8bbe-ade4c1911f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:30.577229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1394/2787] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:30.587136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:30.588987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:30.719561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f597025-cee7-4219-92da-5de309d2f618 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:30.727089 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:30.727497 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.727845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.728133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.742971 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:30.744569 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:30.767278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1394/2788] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:30.899476 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1841-fe57-418f-8c50-11892edf3db7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:30.899803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1841-fe57-418f-8c50-11892edf3db7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:30.900229 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1841-fe57-418f-8c50-11892edf3db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:30.923298 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-665c1841-fe57-418f-8c50-11892edf3db7 None None] MFA Rules not processed for user `674d054767ff4eec993ca7fefdce3967`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:30.924675 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-665c1841-fe57-418f-8c50-11892edf3db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:31.024803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1395/2789] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:31.530300 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:31.594699 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:31.629091 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282875c-6064-4551-a0ef-8f49ed92b9fd service cinder] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:31.635908 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:31.636913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:31.637383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:31.637686 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] PATH_INFO: `/v3/users/3e356b8a11384f6fb032a6a336b5f9e5` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:31.638905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e356b8a11384f6fb032a6a336b5f9e5)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:31.641360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:31.722822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e356b8a11384f6fb032a6a336b5f9e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:31.723546 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e356b8a11384f6fb032a6a336b5f9e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:31.732033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e356b8a11384f6fb032a6a336b5f9e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:31.732737 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e356b8a11384f6fb032a6a336b5f9e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:31.752450 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e356b8a11384f6fb032a6a336b5f9e5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:31.777771 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1395/2790] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:31 2022] DELETE /identity/v3/users/3e356b8a11384f6fb032a6a336b5f9e5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:31.782274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:31.782794 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:31.783084 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:31.805354 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:31.806922 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:31.832543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:31.894267 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1396/2791] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:31.904884 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:31.907170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:31.987670 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52745-4b79-4ee2-9e6a-08203374f39a admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:31.992818 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:31.993603 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:31.994134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:31.994655 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:32.005679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:32.007516 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:32.023333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1396/2792] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:32.128379 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:32.130975 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:32.341348 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e83e9-4ee7-43ba-be78-2bf2e3388718 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:32.349640 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:32.351951 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:32.352685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:32.353179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:32.355630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:32.378410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:32.378770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:32.395693 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1397/2793] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:32.537910 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:32.539654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:32.569860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324e662-7d05-4a60-a54e-9ccdb000d6d6 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:32.587279 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:32.588400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:32.590236 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:32.590632 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] PATH_INFO: `/v3/projects/459c57be8df742f29332c0fb10388444` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:32.598347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459c57be8df742f29332c0fb10388444)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:32.600588 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:32.705796 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459c57be8df742f29332c0fb10388444', 'request_id': 'req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:32.711101 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:32.730875 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459c57be8df742f29332c0fb10388444', 'request_id': 'req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:32.749174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459c57be8df742f29332c0fb10388444', 'request_id': 'req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:32.771232 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] The token cache is being invalidate because project 459c57be8df742f29332c0fb10388444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:32.771800 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:32.772797 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:32.775471 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1397/2794] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:32 2022] DELETE /identity/v3/projects/459c57be8df742f29332c0fb10388444 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:32.779336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:32.795967 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f2fa-5146-4dfa-8ab2-3e530fe3c075 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:32.911215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:32.912101 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:32.912386 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:32.912662 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] PATH_INFO: `/v3/users/3638160ffea04de6b666afed201563cd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:32.913863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3638160ffea04de6b666afed201563cd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:32.915869 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:32.972065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:32.992700 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3638160ffea04de6b666afed201563cd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.007347 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3638160ffea04de6b666afed201563cd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.008126 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3638160ffea04de6b666afed201563cd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.009183 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3638160ffea04de6b666afed201563cd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.021655 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24afa15e-bdc2-4f00-ad26-fa228bb84dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3638160ffea04de6b666afed201563cd'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.054600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1398/2795] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:32 2022] DELETE /identity/v3/users/3638160ffea04de6b666afed201563cd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:33.452028 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:33.453731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:33.472777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7b8a2-2bba-4c2a-be9b-b26ba9a01214 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:33.561956 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:33.563018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:33.563594 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:33.564110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] PATH_INFO: `/v3/projects/8d1caa0c911f4a03b2812bb033a58a3d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:33.565595 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1caa0c911f4a03b2812bb033a58a3d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:33.568792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:33.647314 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1caa0c911f4a03b2812bb033a58a3d', 'request_id': 'req-8150bff1-e7e1-455a-8976-0914e1d3f888'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.661457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1caa0c911f4a03b2812bb033a58a3d', 'request_id': 'req-8150bff1-e7e1-455a-8976-0914e1d3f888'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.681062 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1caa0c911f4a03b2812bb033a58a3d', 'request_id': 'req-8150bff1-e7e1-455a-8976-0914e1d3f888'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.695133 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] The token cache is being invalidate because project 8d1caa0c911f4a03b2812bb033a58a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:33.695524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.696384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-8150bff1-e7e1-455a-8976-0914e1d3f888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:33.701570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1398/2796] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:33 2022] DELETE /identity/v3/projects/8d1caa0c911f4a03b2812bb033a58a3d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:33.705793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:33.706176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:33.706385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:33.747096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:33.747096 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:33.829167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1399/2797] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:33.839811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:33.840584 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:33.841135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:33.873693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:33.875648 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:33.887180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1399/2798] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:33.891793 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:33.902586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca76bc2-79f9-41b6-ace2-3d7ed114ed1b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:33.915457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:33.917714 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:33.918198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:33.921805 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:33.923890 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:33.924247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:33.932031 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:33.956102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1400/2799] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:33.960003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:33.971467 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8dbfa-b11f-4bb2-884a-c02c56a44099 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:33.987838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:33.989443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:33.990014 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:33.990654 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:33.991615 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:33.994138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.042578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1400/2800] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:33 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:34.043756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.059474 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2deb-f7a7-43a0-bf1d-9b52321f0ff9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.166062 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.167661 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.168169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.168627 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.169522 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.171763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.204009 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1401/2801] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:34 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:34.205257 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.222977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1636d93-f74c-416c-8b89-2a5cfb674425 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.237524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.240127 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.240443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.240728 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.241495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.250658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.283098 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1401/2802] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:34.287431 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.298796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1dd3-89fa-41a6-9c05-114aad76ea05 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.305521 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2360-2b64-4e7f-b069-468a466a3e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.308631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2360-2b64-4e7f-b069-468a466a3e69 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.308631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2360-2b64-4e7f-b069-468a466a3e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.308631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2360-2b64-4e7f-b069-468a466a3e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.308631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2360-2b64-4e7f-b069-468a466a3e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.309971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2360-2b64-4e7f-b069-468a466a3e69 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.327097 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1402/2803] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:53:34.328337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.343712 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f65af-dc1a-44ea-8dee-b18a9223c5dc admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.350775 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.351810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.352860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.353540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] PATH_INFO: `/v3/projects/b8af3b81d19d4e1da8953ca1316d4ef0/users/1ee1dc1726514b848a3a4cb9ebc16f8f/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.376738 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8af3b81d19d4e1da8953ca1316d4ef0, user_id=1ee1dc1726514b848a3a4cb9ebc16f8f, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.380554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.406397 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1402/2804] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:34 2022] PUT /identity/v3/projects/b8af3b81d19d4e1da8953ca1316d4ef0/users/1ee1dc1726514b848a3a4cb9ebc16f8f/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:34.483417 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.483726 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.483983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.518783 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] MFA Rules not processed for user `1ee1dc1726514b848a3a4cb9ebc16f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:34.520897 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:34.530715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:34.620807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1403/2805] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:34.625804 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.636331 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:34.712170 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab14e-0a4e-4bc2-9712-065f79d4d9f1 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.717425 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26d847-0bd9-46ce-bd8e-f7ab1abaf9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.718115 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d847-0bd9-46ce-bd8e-f7ab1abaf9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.718487 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d847-0bd9-46ce-bd8e-f7ab1abaf9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.718844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d847-0bd9-46ce-bd8e-f7ab1abaf9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.719887 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d847-0bd9-46ce-bd8e-f7ab1abaf9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.724247 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d847-0bd9-46ce-bd8e-f7ab1abaf9f0 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.759224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1403/2806] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:34 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:34.760672 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.772837 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6c1c-8f8c-4888-80b5-cc9e9ffd5710 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.877059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.877996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.878403 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.878904 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.880166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.886916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.887222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.887652 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.888282 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.909977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] MFA Rules not processed for user `7edc2b1d056341aaa31751f77cd03a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:34.911987 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:34.925186 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1404/2807] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:34 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:53:34.930430 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.945287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0544de-8dca-4d0e-85df-33ea81da363f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.951959 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.952925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.953601 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:34.954220 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:34.955100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:34.957969 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:34.974715 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1405/2808] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:34.979300 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:34.992676 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11074e0c-449a-4724-a451-11d2977a015b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:34.998044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:34.999361 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:34.999856 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:35.000355 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] PATH_INFO: `/v3/projects/018f53582b734cf393ee90980f8393ac/users/849ba22c71c94fc89e0fafc8a220fd0e/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:35.010943 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1404/2809] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:35.021558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018f53582b734cf393ee90980f8393ac, user_id=849ba22c71c94fc89e0fafc8a220fd0e, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:35.025937 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:35.056600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1406/2810] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:34 2022] PUT /identity/v3/projects/018f53582b734cf393ee90980f8393ac/users/849ba22c71c94fc89e0fafc8a220fd0e/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:35.060463 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:35.076821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caea72f-6eff-411a-9573-ffe7deb7260d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:35.159364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17962d3d-f363-44f1-a425-ffb14ac1a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:35.162981 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17962d3d-f363-44f1-a425-ffb14ac1a473 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:35.163578 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17962d3d-f363-44f1-a425-ffb14ac1a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:35.164716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17962d3d-f363-44f1-a425-ffb14ac1a473 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:35.165545 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17962d3d-f363-44f1-a425-ffb14ac1a473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:35.167298 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17962d3d-f363-44f1-a425-ffb14ac1a473 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:35.180076 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1405/2811] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:35.184721 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:35.196854 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b66b13-e068-40d0-a354-3ad2302686e2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:35.202344 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:35.203301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:35.203632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:35.204070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] PATH_INFO: `/v3/projects/018f53582b734cf393ee90980f8393ac/users/849ba22c71c94fc89e0fafc8a220fd0e/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:35.206315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018f53582b734cf393ee90980f8393ac, user_id=849ba22c71c94fc89e0fafc8a220fd0e, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:35.212788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:35.225100 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1407/2812] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:35 2022] PUT /identity/v3/projects/018f53582b734cf393ee90980f8393ac/users/849ba22c71c94fc89e0fafc8a220fd0e/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:35.235882 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:35.236475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:35.236856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:35.273853 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] MFA Rules not processed for user `849ba22c71c94fc89e0fafc8a220fd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:35.275495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:35.303327 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:35.366080 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1406/2813] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:35.380681 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:35.382495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:35.449992 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94054-942c-4cad-afeb-ed69ac5195c0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:35.454849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82774438-9fe8-4da0-8d5f-4ce57b2a1157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:35.455532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774438-9fe8-4da0-8d5f-4ce57b2a1157 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:35.455832 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774438-9fe8-4da0-8d5f-4ce57b2a1157 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:35.456094 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774438-9fe8-4da0-8d5f-4ce57b2a1157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:35.463481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:35.471255 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82774438-9fe8-4da0-8d5f-4ce57b2a1157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:35.475032 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82774438-9fe8-4da0-8d5f-4ce57b2a1157 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:35.490829 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1408/2814] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:36.094535 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:36.180631 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2350-99a0-4b73-97f2-72e600d85432 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:36.186913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:36.187570 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:36.187960 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:36.188338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] PATH_INFO: `/v3/users/1ee1dc1726514b848a3a4cb9ebc16f8f` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:36.192663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee1dc1726514b848a3a4cb9ebc16f8f)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:36.192663 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:36.258267 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee1dc1726514b848a3a4cb9ebc16f8f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.259336 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee1dc1726514b848a3a4cb9ebc16f8f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.268136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee1dc1726514b848a3a4cb9ebc16f8f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.268945 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee1dc1726514b848a3a4cb9ebc16f8f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.284273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee1dc1726514b848a3a4cb9ebc16f8f'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.307228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1407/2815] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:36 2022] DELETE /identity/v3/users/1ee1dc1726514b848a3a4cb9ebc16f8f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:36.311923 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:36.312429 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:36.312529 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:36.337116 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:36.339304 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:36.415558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1409/2816] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:36.426057 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:36.427905 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:36.476198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:36.493345 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3de80-ff5f-4e64-81a8-86169a1c3720 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:36.497017 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:36.497789 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:36.498097 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:36.498403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:36.508576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:36.510030 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:36.520572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1408/2817] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:36.858938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:36.860457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:36.874499 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0a83f-c340-4eda-abe9-123ade31e78f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:36.881261 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:36.882144 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:36.882457 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:36.882806 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] PATH_INFO: `/v3/projects/b8af3b81d19d4e1da8953ca1316d4ef0` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:36.884543 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8af3b81d19d4e1da8953ca1316d4ef0)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:36.886740 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:36.936167 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8af3b81d19d4e1da8953ca1316d4ef0', 'request_id': 'req-16acaed4-dbc1-4255-a5b3-5844afa8a314'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.942574 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8af3b81d19d4e1da8953ca1316d4ef0', 'request_id': 'req-16acaed4-dbc1-4255-a5b3-5844afa8a314'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.949179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8af3b81d19d4e1da8953ca1316d4ef0', 'request_id': 'req-16acaed4-dbc1-4255-a5b3-5844afa8a314'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.962902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] The token cache is being invalidate because project b8af3b81d19d4e1da8953ca1316d4ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:36.963191 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.963902 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:36.965562 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1410/2818] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:36 2022] DELETE /identity/v3/projects/b8af3b81d19d4e1da8953ca1316d4ef0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:36.969566 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:36.979206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14838-77f3-4803-b61a-ab5164f24f80 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:37.039868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:37.043094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:37.043094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:37.043094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] PATH_INFO: `/v3/users/849ba22c71c94fc89e0fafc8a220fd0e` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:37.043094 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849ba22c71c94fc89e0fafc8a220fd0e)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:37.045130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:37.130021 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849ba22c71c94fc89e0fafc8a220fd0e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:37.135039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849ba22c71c94fc89e0fafc8a220fd0e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:37.161799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849ba22c71c94fc89e0fafc8a220fd0e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:37.163527 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849ba22c71c94fc89e0fafc8a220fd0e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:37.205110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-6bdbfa3a-0c88-4ffa-9dd9-c32ac13d2103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849ba22c71c94fc89e0fafc8a220fd0e'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:37.264530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1409/2819] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:36 2022] DELETE /identity/v3/users/849ba22c71c94fc89e0fafc8a220fd0e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:37.991972 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:37.993540 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:38.013579 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acaed4-dbc1-4255-a5b3-5844afa8a314 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.095586 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.096467 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.096817 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.097108 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] PATH_INFO: `/v3/projects/018f53582b734cf393ee90980f8393ac` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.099303 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=018f53582b734cf393ee90980f8393ac)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.101739 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.124819 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:38.155915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018f53582b734cf393ee90980f8393ac', 'request_id': 'req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:38.163110 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018f53582b734cf393ee90980f8393ac', 'request_id': 'req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:38.173320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018f53582b734cf393ee90980f8393ac', 'request_id': 'req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:38.187441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] The token cache is being invalidate because project 018f53582b734cf393ee90980f8393ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:38.187735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:38.188381 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0e96e4e3-c205-4ef5-9df6-cd5a1284f0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:38.190095 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1411/2820] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:37 2022] DELETE /identity/v3/projects/018f53582b734cf393ee90980f8393ac => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:38.195802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.196657 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.197154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.216703 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:38.218134 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:38.277502 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:38.297957 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1410/2821] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:53:38.299558 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.299857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.300141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.329210 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:38.330468 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:38.353054 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1412/2822] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:38.357941 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.372720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0cef9-b48c-47d5-9e39-2a31d0cbca57 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.377718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.378422 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.379260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.379567 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.380305 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:53:38.380614 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.382235 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.396673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1411/2823] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:53:38.400844 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.412057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0938c-e0e4-438f-a48b-566e8898aefb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.419251 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.420237 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.421329 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.421813 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.422735 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.426514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.464432 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1413/2824] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:53:38 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:38.468592 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.480489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89977-0824-4795-b0a1-73567f56d592 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.567229 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.568993 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.569394 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.569814 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.570748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.572860 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.603410 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1412/2825] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:53:38 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:53:38.607514 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.623575 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6e65-3995-4dfb-9288-d34b86986d81 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.634717 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.635593 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.636233 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.636703 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.637867 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.639863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.652612 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1414/2826] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:38.656510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.667792 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f745-04aa-4f54-ac0b-5d32dc4e3d71 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.673554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cd544-a13f-4215-9900-503279482f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.674260 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cd544-a13f-4215-9900-503279482f11 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.674576 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cd544-a13f-4215-9900-503279482f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.674854 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cd544-a13f-4215-9900-503279482f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.675587 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cd544-a13f-4215-9900-503279482f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.677714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cd544-a13f-4215-9900-503279482f11 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.688781 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1413/2827] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:53:38.693435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.705335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6631b5-17b2-45d3-b516-a5b25bf66fe9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.710699 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.711582 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.712050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.712316 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] PATH_INFO: `/v3/projects/1da63316f47749cb9c99719dac401f80/users/c76d2b0a71ae46448819cbcb3ac03cb5/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.729025 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da63316f47749cb9c99719dac401f80, user_id=c76d2b0a71ae46448819cbcb3ac03cb5, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.731807 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.746820 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1415/2828] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:53:38 2022] PUT /identity/v3/projects/1da63316f47749cb9c99719dac401f80/users/c76d2b0a71ae46448819cbcb3ac03cb5/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:53:38.758906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.759198 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.759478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.791469 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] MFA Rules not processed for user `c76d2b0a71ae46448819cbcb3ac03cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:38.792969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:38.884431 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1414/2829] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:38.895224 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:38.897016 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:38.959525 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb431a9-636a-480c-a18f-7e603a6b9737 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:38.963365 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c2e55-4043-4a92-a2c2-ce91efaa640e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:38.964026 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2e55-4043-4a92-a2c2-ce91efaa640e service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:38.964315 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2e55-4043-4a92-a2c2-ce91efaa640e service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:38.964600 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2e55-4043-4a92-a2c2-ce91efaa640e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:38.974901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c2e55-4043-4a92-a2c2-ce91efaa640e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:38.976441 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c2e55-4043-4a92-a2c2-ce91efaa640e service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:38.985885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1416/2830] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:48.877367 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:48.982067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:49.192719 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:49.267931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb229b8-d2f1-44f7-b8e3-04ee95a97b11 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:49.273596 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:49.274536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:49.274822 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:49.275110 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] PATH_INFO: `/v3/users/c76d2b0a71ae46448819cbcb3ac03cb5` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:49.276344 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76d2b0a71ae46448819cbcb3ac03cb5)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:49.278273 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:49.336084 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76d2b0a71ae46448819cbcb3ac03cb5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.336843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76d2b0a71ae46448819cbcb3ac03cb5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.347185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76d2b0a71ae46448819cbcb3ac03cb5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.347391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76d2b0a71ae46448819cbcb3ac03cb5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.356264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76d2b0a71ae46448819cbcb3ac03cb5'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.375666 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1415/2831] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:53:49 2022] DELETE /identity/v3/users/c76d2b0a71ae46448819cbcb3ac03cb5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:49.380958 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:49.381259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:49.381544 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:49.405356 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:49.407166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:49.469106 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1417/2832] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:49.479104 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:49.480492 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:49.538228 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f8c5-2a16-475d-aa77-857a3a9d4560 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:49.541828 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:49.542777 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:49.543064 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:49.543347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:49.552369 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:49.553810 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:49.563150 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1416/2833] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:49.897093 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:49.899293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:49.911825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e53ca-a57b-4b36-a2c2-37481339a089 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:49.916583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:49.917709 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:49.917996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:49.918277 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] PATH_INFO: `/v3/projects/1da63316f47749cb9c99719dac401f80` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:49.919508 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da63316f47749cb9c99719dac401f80)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:49.921418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:49.968035 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da63316f47749cb9c99719dac401f80', 'request_id': 'req-a5c34b82-9948-4022-a2b4-5d9436242c9d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.973859 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da63316f47749cb9c99719dac401f80', 'request_id': 'req-a5c34b82-9948-4022-a2b4-5d9436242c9d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.980015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da63316f47749cb9c99719dac401f80', 'request_id': 'req-a5c34b82-9948-4022-a2b4-5d9436242c9d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.992411 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] The token cache is being invalidate because project 1da63316f47749cb9c99719dac401f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:53:49.993037 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.993385 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a5c34b82-9948-4022-a2b4-5d9436242c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:53:49.994970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1418/2834] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:53:49 2022] DELETE /identity/v3/projects/1da63316f47749cb9c99719dac401f80 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:53:50.904912 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:50.923790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd9ce4-1ba6-495b-8b51-859c568c4f7c service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:50.945066 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:50.992039 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:50.992873 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:50.993173 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:50.993579 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:50.996435 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:51.087363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:51.088520 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:51.111562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1417/2835] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:53:56.705448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:56.705989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:56.705989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:56.736632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:53:56.737864 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:56.796614 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1419/2836] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:53:56.844112 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:56.845517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:56.915460 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ffbe6-1453-4465-b80b-924ddce0dfa2 service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:56.920741 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac51445-b518-458d-b823-0976d85e023e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:56.921362 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51445-b518-458d-b823-0976d85e023e service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:56.921651 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51445-b518-458d-b823-0976d85e023e service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:56.921931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51445-b518-458d-b823-0976d85e023e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:56.930299 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac51445-b518-458d-b823-0976d85e023e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:56.931915 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac51445-b518-458d-b823-0976d85e023e service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:56.939947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1418/2837] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:54:06.020301 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:06.021934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:06.040326 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee940948-1b3b-4776-b7d6-6e3e186e2a12 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:06.044407 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:06.045065 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:06.045351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:06.045631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:06.047674 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:06.074885 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:06.148362 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:06.149825 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:06.163098 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1420/2838] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:54:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:54:06.936696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=72 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:12.238332 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:12.239037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:12.239037 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:12.256718 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:12.257896 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:12.265002 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1419/2839] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 19 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:12.276916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:12.288505 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc6ed-1f49-4347-ba8c-e6d67cdcd4b9 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:12.293968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:12.294649 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:12.294938 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:12.295221 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:12.304002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:12.305572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:12.313599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1421/2840] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:54:14.227911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:14.229630 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:14.296833 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fd18c-497b-4de8-9acd-d16815965a18 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:14.302196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:14.303095 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.303382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.303665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] PATH_INFO: `/v3/users/7edc2b1d056341aaa31751f77cd03a2c` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:14.304870 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7edc2b1d056341aaa31751f77cd03a2c)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:14.306835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:14.352164 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7edc2b1d056341aaa31751f77cd03a2c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.352815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7edc2b1d056341aaa31751f77cd03a2c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.359540 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7edc2b1d056341aaa31751f77cd03a2c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.360159 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7edc2b1d056341aaa31751f77cd03a2c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.367951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-ff0cab2e-955f-42ec-b8da-09b1e8e5dc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7edc2b1d056341aaa31751f77cd03a2c'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.384950 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1420/2841] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:54:14 2022] DELETE /identity/v3/users/7edc2b1d056341aaa31751f77cd03a2c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:14.560756 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:14.572349 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa56f-7877-499b-8abe-b3a9d0146e59 service swift] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:14.630915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:14.631788 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.632078 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.632360 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] PATH_INFO: `/v3/projects/628680bdad9c4d2ebcb019bb40053ccc` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:14.633609 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] RBAC: Authorizing `identity:delete_project(project_id=628680bdad9c4d2ebcb019bb40053ccc)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:14.635550 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:14.686231 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628680bdad9c4d2ebcb019bb40053ccc', 'request_id': 'req-5719fa89-e047-431f-875f-bf7107f283af'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.691397 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628680bdad9c4d2ebcb019bb40053ccc', 'request_id': 'req-5719fa89-e047-431f-875f-bf7107f283af'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.697518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628680bdad9c4d2ebcb019bb40053ccc', 'request_id': 'req-5719fa89-e047-431f-875f-bf7107f283af'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.711000 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] The token cache is being invalidate because project 628680bdad9c4d2ebcb019bb40053ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:54:14.711305 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.711924 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5719fa89-e047-431f-875f-bf7107f283af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:14.713489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1422/2842] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:54:14 2022] DELETE /identity/v3/projects/628680bdad9c4d2ebcb019bb40053ccc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:14.718564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.718858 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.719146 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:14.738008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:14.739426 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:14.804701 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1421/2843] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:14.812273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.812566 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.812848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:14.831925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:14.833204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:14.841262 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1423/2844] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:14.845536 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:14.856256 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb2a5-1719-4c79-b05b-c7b1d1c9a0e9 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:14.860816 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:14.861475 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.861763 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.862045 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:14.863517 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:54:14.863842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:14.865441 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:14.873843 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:14.877559 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1422/2845] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:54:14.883117 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:14.892641 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b9c4-a67f-471e-8a07-bc76ae6cd999 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:14.897483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:14.898138 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.898459 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.898746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:14.899447 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:14.901357 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:14.927632 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1424/2846] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:54:14 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:54:14.931844 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:14.942096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963711f6-9a46-4c8d-8add-811ba6201182 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:14.998478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:14.999144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:14.999432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:14.999714 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.000415 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.002346 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.021465 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1423/2847] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:54:14 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:54:15.025631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.031242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:15.039069 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dca65-85f0-4656-bf5a-e35012ce4cd5 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.045283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.045954 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.046266 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.046583 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.047321 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.048915 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.060248 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1425/2848] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:54:15.066590 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.077454 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc588-191e-4fe5-8c00-040e32eb2f6b admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.083118 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49899-c485-4b2a-81c4-228995500680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.083776 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49899-c485-4b2a-81c4-228995500680 admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.084056 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49899-c485-4b2a-81c4-228995500680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.084329 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49899-c485-4b2a-81c4-228995500680 admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.085049 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c49899-c485-4b2a-81c4-228995500680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.086665 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c49899-c485-4b2a-81c4-228995500680 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.096758 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1424/2849] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:54:15.100965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.111015 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca8de-e0bb-45c9-a6ea-23dd58ac8181 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.115786 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.116660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.116947 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.117228 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] PATH_INFO: `/v3/projects/5085f8ef5eef4d6a8c009fdb636bd818/users/2cd681a2b00b40669c0538bb5a21f65d/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.132763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5085f8ef5eef4d6a8c009fdb636bd818, user_id=2cd681a2b00b40669c0538bb5a21f65d, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.135481 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.149283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1426/2850] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:54:15 2022] PUT /identity/v3/projects/5085f8ef5eef4d6a8c009fdb636bd818/users/2cd681a2b00b40669c0538bb5a21f65d/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:15.160418 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.160720 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.161011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.187641 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] MFA Rules not processed for user `2cd681a2b00b40669c0538bb5a21f65d`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:15.188857 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:15.252649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1425/2851] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:15.264353 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.266067 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:15.323537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574bf3-3762-4fab-a69f-51f336a9263a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.327063 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff159960-e9d7-4928-a0a8-f2f048cb8a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1660a20af64b189516d5dd4b31a9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.327694 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff159960-e9d7-4928-a0a8-f2f048cb8a9a service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.327978 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff159960-e9d7-4928-a0a8-f2f048cb8a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.328254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff159960-e9d7-4928-a0a8-f2f048cb8a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.336382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff159960-e9d7-4928-a0a8-f2f048cb8a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.337796 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff159960-e9d7-4928-a0a8-f2f048cb8a9a service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.346510 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1427/2852] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:54:15.370811 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.439350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8ddd6-deca-49ad-8ca8-7f387ef54a2d None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.445521 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.446443 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.446730 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.447008 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] PATH_INFO: `/v3/users/2cd681a2b00b40669c0538bb5a21f65d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.448233 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd681a2b00b40669c0538bb5a21f65d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.450163 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.462136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:15.497764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd681a2b00b40669c0538bb5a21f65d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:15.498457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd681a2b00b40669c0538bb5a21f65d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:15.505937 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd681a2b00b40669c0538bb5a21f65d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:15.506638 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd681a2b00b40669c0538bb5a21f65d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:15.514184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd681a2b00b40669c0538bb5a21f65d'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:15.532151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1426/2853] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:54:15 2022] DELETE /identity/v3/users/2cd681a2b00b40669c0538bb5a21f65d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:15.537399 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.537696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.537983 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.556057 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:15.557295 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:15.616588 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1428/2854] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:15.626411 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.627842 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:15.685289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693bd3b-cc40-4818-880b-6100c91b8852 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.688995 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8f95-acd0-4b25-b895-5077c702fbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.689637 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8f95-acd0-4b25-b895-5077c702fbaa service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.689924 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8f95-acd0-4b25-b895-5077c702fbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.690205 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8f95-acd0-4b25-b895-5077c702fbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.699893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8f95-acd0-4b25-b895-5077c702fbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.701324 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8f95-acd0-4b25-b895-5077c702fbaa service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:15.711597 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1427/2855] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:54:15.975309 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:15.976778 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:15.990080 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72fef8-9b02-44aa-8e14-4778f6d2c54b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:15.994843 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:15.995713 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:15.995999 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:15.996283 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] PATH_INFO: `/v3/projects/5085f8ef5eef4d6a8c009fdb636bd818` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:15.997587 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5085f8ef5eef4d6a8c009fdb636bd818)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:15.999971 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.047991 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5085f8ef5eef4d6a8c009fdb636bd818', 'request_id': 'req-abc73810-30b2-4fd4-ab03-be39db843816'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:16.053453 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5085f8ef5eef4d6a8c009fdb636bd818', 'request_id': 'req-abc73810-30b2-4fd4-ab03-be39db843816'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:16.059450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5085f8ef5eef4d6a8c009fdb636bd818', 'request_id': 'req-abc73810-30b2-4fd4-ab03-be39db843816'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:16.061892 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:16.072935 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] The token cache is being invalidate because project 5085f8ef5eef4d6a8c009fdb636bd818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:54:16.073247 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:16.073899 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-abc73810-30b2-4fd4-ab03-be39db843816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:54:16.075490 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1429/2856] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:54:15 2022] DELETE /identity/v3/projects/5085f8ef5eef4d6a8c009fdb636bd818 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:16.080601 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.080899 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.081187 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.100366 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:16.101572 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:16.160143 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1428/2857] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:16.168402 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.168720 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.169010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.188047 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:16.189252 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:16.197626 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1430/2858] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:16.201907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.212412 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f565-a6b0-4fc3-a0bf-3a77e1fb9b3a None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.217073 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.217725 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.218015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.218296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] PATH_INFO: `/v3/domains` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.219059 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:54:16.219403 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.221001 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.236392 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1429/2859] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 19 15:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:54:16.237495 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.247239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb85434-e3d0-456f-9d57-d73e60e51aee None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.253962 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.254666 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.255124 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.255409 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.256121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.258070 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.283595 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1431/2860] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:54:16 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:54:16.288281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.298489 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca36a1-4c97-4310-8d59-3167e282e91a admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.311206 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:16.357182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.357850 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.358140 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.358459 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.359151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.361072 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.381685 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1430/2861] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:54:16 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:54:16.385863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.399440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4bb1e-9134-4512-a04d-06057808e7cf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.405635 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.406501 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.406833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.407194 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.407965 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.410121 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.421135 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1432/2862] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:54:16.425151 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.435847 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41391-9548-4c05-984f-91366d7cfae5 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.440524 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6facbd-0e75-4bb6-9294-b837168d547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.441402 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6facbd-0e75-4bb6-9294-b837168d547a admin admin] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.441693 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6facbd-0e75-4bb6-9294-b837168d547a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.441975 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6facbd-0e75-4bb6-9294-b837168d547a admin admin] PATH_INFO: `/v3/roles` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.442790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6facbd-0e75-4bb6-9294-b837168d547a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.444382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6facbd-0e75-4bb6-9294-b837168d547a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.454413 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1431/2863] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:54:16.458484 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.468211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67847500-e1d6-4ca9-aee7-de789efbd56b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.473638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.474572 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.474861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.475133 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] PATH_INFO: `/v3/projects/6a9e5f3b931d47b6bfb7938a89c2a37d/users/8a63627dc4624d9c8b73bcbfcc11fbf8/roles/7847dd8004504fe890aac6ff853967c8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.490141 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9e5f3b931d47b6bfb7938a89c2a37d, user_id=8a63627dc4624d9c8b73bcbfcc11fbf8, role_id=7847dd8004504fe890aac6ff853967c8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.492809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.506164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1433/2864] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:54:16 2022] PUT /identity/v3/projects/6a9e5f3b931d47b6bfb7938a89c2a37d/users/8a63627dc4624d9c8b73bcbfcc11fbf8/roles/7847dd8004504fe890aac6ff853967c8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:54:16.511432 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd541e5b-e922-4ab7-b9c0-002c84a87c51 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.511727 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd541e5b-e922-4ab7-b9c0-002c84a87c51 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.512009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd541e5b-e922-4ab7-b9c0-002c84a87c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.529561 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-cd541e5b-e922-4ab7-b9c0-002c84a87c51 None None] MFA Rules not processed for user `dc78df0f6ac445d5b0a04a3f9969c79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:16.531613 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-cd541e5b-e922-4ab7-b9c0-002c84a87c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:16.592382 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1432/2865] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:16.602758 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:16.604473 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:16.661696 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226f82-370a-4c29-81c7-2174d61c99bb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:16.665205 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:16.665846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:16.666131 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:16.666438 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:16.677274 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:16.679176 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:16.688996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1434/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:54:20.683542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:20.684024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:20.684335 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:20.717965 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] MFA Rules not processed for user `8a63627dc4624d9c8b73bcbfcc11fbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:20.719250 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:20.796099 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1433/2867] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:20.801018 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:20.811302 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5373-8fc2-4122-bff1-af4c4f57b17b service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:20.816623 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:20.817594 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:20.817888 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:20.818169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:20.819002 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:20.820934 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:20.848532 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1435/2868] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 19 15:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:54:20.852550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:20.863553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201aaf-f4ac-491c-8cdb-a4f0489571a5 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:20.888969 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:20.927679 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:20.928277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:20.928560 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:20.928838 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] PATH_INFO: `/v3/users` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:20.929554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:20.931530 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:20.956184 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1434/2869] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 19 15:54:20 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:54:20.957443 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:20.967857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ef62-9cf3-496a-85e6-9ae5b94053da admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:20.973376 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:20.973916 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:20.974196 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:20.974507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:20.975242 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:20.976848 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:20.988352 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1436/2870] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:54:20.992531 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:21.003003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a757188-7d26-4901-a21a-bc34bd537925 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:21.008388 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:21.009338 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:21.009617 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:21.009895 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] PATH_INFO: `/v3/projects/da347b264fed4a4f922936ec4a2af873/users/6c90499e0eb242a3832de85aac411fb6/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:21.026478 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da347b264fed4a4f922936ec4a2af873, user_id=6c90499e0eb242a3832de85aac411fb6, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:21.029196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:21.044016 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1435/2871] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:54:20 2022] PUT /identity/v3/projects/da347b264fed4a4f922936ec4a2af873/users/6c90499e0eb242a3832de85aac411fb6/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:21.048001 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:21.058576 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5d45-2168-4fd5-a772-a8831e41d237 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:21.119920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c9a8-6235-421c-af2b-a004d9cbacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:21.120603 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c9a8-6235-421c-af2b-a004d9cbacc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:21.120886 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c9a8-6235-421c-af2b-a004d9cbacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:21.121164 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c9a8-6235-421c-af2b-a004d9cbacc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:21.121901 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2c9a8-6235-421c-af2b-a004d9cbacc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:21.123518 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2c9a8-6235-421c-af2b-a004d9cbacc5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:21.125189 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:21.135997 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1437/2872] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 19 15:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:54:21.140058 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:21.151096 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e0865-c26e-4bf0-b645-97e805c3e043 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:21.155947 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:21.156931 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] REQUEST_METHOD: `PUT` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:21.157363 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:21.157716 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] PATH_INFO: `/v3/projects/da347b264fed4a4f922936ec4a2af873/users/6c90499e0eb242a3832de85aac411fb6/roles/d30b9543b0b7460283d44cf48ff820e9` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:21.160558 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da347b264fed4a4f922936ec4a2af873, user_id=6c90499e0eb242a3832de85aac411fb6, role_id=d30b9543b0b7460283d44cf48ff820e9)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:21.163488 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:21.175784 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1436/2873] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 19 15:54:21 2022] PUT /identity/v3/projects/da347b264fed4a4f922936ec4a2af873/users/6c90499e0eb242a3832de85aac411fb6/roles/d30b9543b0b7460283d44cf48ff820e9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:54:25.768644 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755aae-62a2-4389-a13e-7ae37252ee63 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:25.770487 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755aae-62a2-4389-a13e-7ae37252ee63 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:25.770966 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755aae-62a2-4389-a13e-7ae37252ee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:25.813770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cb755aae-62a2-4389-a13e-7ae37252ee63 None None] MFA Rules not processed for user `6c90499e0eb242a3832de85aac411fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:25.815335 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cb755aae-62a2-4389-a13e-7ae37252ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:25.962814 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1438/2874] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:25.971270 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:25.974405 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:26.073136 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b5a6-9fb9-414d-b4c3-05e444fc0902 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:26.078834 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58e091aa0ceb4548999be36c96c7dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:26.080138 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:26.080424 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:26.080704 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:26.147009 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:26.148515 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:26.157802 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1437/2875] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:54:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:54:26.272970 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7051c-01fb-42dc-8c96-537d587c1746 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:26.273263 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7051c-01fb-42dc-8c96-537d587c1746 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:26.273537 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7051c-01fb-42dc-8c96-537d587c1746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:26.293346 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b7f7051c-01fb-42dc-8c96-537d587c1746 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:26.294624 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b7f7051c-01fb-42dc-8c96-537d587c1746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:26.373259 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1439/2876] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:54:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:26.387190 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:26.394996 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:26.442067 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:26.483553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918edcdc-f60c-463f-896c-df5e00e74d81 service glance] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:26.489225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67868287-4231-4926-966b-817f552342ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:26.489893 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67868287-4231-4926-966b-817f552342ad service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:26.490185 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67868287-4231-4926-966b-817f552342ad service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:26.490501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67868287-4231-4926-966b-817f552342ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:26.499553 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67868287-4231-4926-966b-817f552342ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:26.501264 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67868287-4231-4926-966b-817f552342ad service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:26.512296 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1438/2877] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:54:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:54:35.171631 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:35.172140 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:35.172243 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:35.190336 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] MFA Rules not processed for user `8a63627dc4624d9c8b73bcbfcc11fbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:35.191925 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:35.198824 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1440/2878] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 19 15:54:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:54:36.508216 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=17 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:36.911399 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] REQUEST_METHOD: `POST` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:36.911580 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:36.911868 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:36.934448 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.auth.core [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:54:36.935683 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:54:36.944225 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1439/2879] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 19 15:54:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:54:36.957950 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:54:36.971169 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40d22e-abb4-44bc-b932-f023b9e40aba None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:54:36.977166 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:54:36.977860 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:54:36.978149 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:54:36.978461 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:54:36.987378 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:54:36.989046 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:54:36.997913 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1441/2880] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:54:46.928175 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=3 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:46.994179 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=70 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:02.394123 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:02.396277 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:02.452040 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c334675-8a85-4ddd-ae63-e1f49d8c62f0 None None] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:02.455547 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:02.456182 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:02.456468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:02.456903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:02.465695 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:02.467144 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:02.476436 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1440/2881] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:55:12.472658 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=26 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:40.903599 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:40.913928 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e7d3-a07b-4cb1-8f58-c2a0c441f13b service swift] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:40.917198 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:40.917849 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:40.918137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:40.918448 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:40.920668 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:40.997222 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:40.998752 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:41.010689 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1442/2882] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:55:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:55:41.944906 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:41.953660 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc2a4-7a33-4f88-b2dc-86e61e98a92b service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:41.957598 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:41.958316 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:41.958696 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:41.959042 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:41.961731 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:41.976511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:41.978222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:41.989479 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1441/2883] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:55:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:55:46.175770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:46.185327 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0d63-f948-4a58-bd1a-45bb88902c8f service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:46.188985 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:46.189630 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:46.189920 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:46.190215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:46.192746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:46.256737 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:46.258330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:46.269400 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1443/2884] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:55:51.984568 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=6 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:52.492748 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:52.494385 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:52.515752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db10dae-0cc4-433a-a840-cf5c5353f03c service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:52.520485 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:52.521360 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:52.521649 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:52.521932 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] PATH_INFO: `/v3/users/ae334c4d93cd4d3e94789a5985fcfa77` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:52.523977 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae334c4d93cd4d3e94789a5985fcfa77)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:52.526135 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:52.574160 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae334c4d93cd4d3e94789a5985fcfa77'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.574734 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae334c4d93cd4d3e94789a5985fcfa77'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.581644 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae334c4d93cd4d3e94789a5985fcfa77'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.582281 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae334c4d93cd4d3e94789a5985fcfa77'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.590472 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae334c4d93cd4d3e94789a5985fcfa77'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.608011 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1442/2885] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:55:52 2022] DELETE /identity/v3/users/ae334c4d93cd4d3e94789a5985fcfa77 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:55:52.781822 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:52.792797 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630f0f-6ed3-42b1-bd45-e078455927b5 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:52.849602 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:52.850488 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:52.850768 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:52.851045 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] PATH_INFO: `/v3/projects/6827afcdf1f3481882f808dc01908a4d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:52.852857 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6827afcdf1f3481882f808dc01908a4d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:52.854785 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:52.879151 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:52.902504 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6827afcdf1f3481882f808dc01908a4d', 'request_id': 'req-4643f6ad-66f3-48f6-afd1-597049086887'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.907977 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6827afcdf1f3481882f808dc01908a4d', 'request_id': 'req-4643f6ad-66f3-48f6-afd1-597049086887'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.915102 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6827afcdf1f3481882f808dc01908a4d', 'request_id': 'req-4643f6ad-66f3-48f6-afd1-597049086887'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.928211 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] The token cache is being invalidate because project 6827afcdf1f3481882f808dc01908a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:55:52.928507 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.929132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:52.931306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1444/2886] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:55:52 2022] DELETE /identity/v3/projects/6827afcdf1f3481882f808dc01908a4d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:55:52.935289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:52.936706 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:52.950278 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dea946-923b-4ff7-97d9-8352ac776c36 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:53.006511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:53.008027 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:53.008365 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:53.008610 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] PATH_INFO: `/v3/users/de5ac74177c9406aae98af215872c997` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:53.009835 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5ac74177c9406aae98af215872c997)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:53.011817 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:53.058510 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5ac74177c9406aae98af215872c997'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.059162 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5ac74177c9406aae98af215872c997'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.068246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5ac74177c9406aae98af215872c997'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.069290 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5ac74177c9406aae98af215872c997'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.078333 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5ac74177c9406aae98af215872c997'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.086274 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:53.097562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1443/2887] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:55:52 2022] DELETE /identity/v3/users/de5ac74177c9406aae98af215872c997 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:55:53.268651 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:55:53.270122 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:55:53.283418 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643f6ad-66f3-48f6-afd1-597049086887 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:55:53.341911 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:55:53.342804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:55:53.343091 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:55:53.343415 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] PATH_INFO: `/v3/projects/bc5b6a62a8384289937a094bac0d6d17` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:55:53.344590 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5b6a62a8384289937a094bac0d6d17)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:55:53.346527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:55:53.392639 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5b6a62a8384289937a094bac0d6d17', 'request_id': 'req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.397955 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5b6a62a8384289937a094bac0d6d17', 'request_id': 'req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.404010 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5b6a62a8384289937a094bac0d6d17', 'request_id': 'req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.417234 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] The token cache is being invalidate because project bc5b6a62a8384289937a094bac0d6d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:55:53.417516 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.418159 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:55:53.419996 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1445/2888] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:55:53 2022] DELETE /identity/v3/projects/bc5b6a62a8384289937a094bac0d6d17 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:56:03.096798 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:03.414050 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:11.274077 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:11.275564 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:11.333342 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7f02-ba2a-41d6-b4c5-39b6a98c99ca admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:11.380297 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7f97cf493c4b118a96025ee33f27a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:11.380942 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:11.381224 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:11.381501 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:11.383845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:11.393033 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:11.394482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:11.403007 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1444/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:56:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:56:14.905059 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:14.906628 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:14.978464 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda43895-bda7-4c64-86e1-ae25aa8fa4ca admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:14.983440 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:14.984137 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:14.984426 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:14.984707 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:14.986515 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:14.998044 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:14.999660 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:15.010293 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1446/2890] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:56:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:56:17.558821 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:17.560400 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:17.637907 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a140b-d77d-489b-a650-51997da0c68b service neutron] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:17.643350 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:17.643998 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:17.644289 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:17.644582 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:17.646398 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:17.659983 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:17.661549 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:17.673337 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1445/2891] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:56:19.697891 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:19.699746 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:19.721428 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417a44-8074-4b3b-9a21-b6b16e75f125 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:19.729209 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:19.730111 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:19.730620 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:19.731132 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:19.733239 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:19.751559 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:19.753254 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb7468-0437-42b8-aaf6-7b9f87f790dc service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:19.768435 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1447/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:56:20.852662 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:20.865760 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5916495-e1f2-4a78-a064-3b36a7cd9980 service nova] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:20.871003 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3981687a6c741afbd3d22eb49fe4da7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:20.871740 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:20.872100 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:20.872457 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:20.874477 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:20.889130 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:20.891186 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:20.905495 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1446/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:56:28.072745 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:28.073215 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:28.073330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:28.120949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] MFA Rules not processed for user `232b92d1afef4044bf608e629de2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:56:28.122142 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:28.185410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1448/2894] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 19 15:56:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:56:28.225383 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:28.226917 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:28.261044 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=100 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:28.315959 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9937fd-7562-4df3-b4cd-b037fed26a37 service nova] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:28.321508 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06c607bcb83464791b3c0b965bce133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:28.322154 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:28.322473 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:28.322761 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:28.330913 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:28.332493 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:28.340756 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1447/2895] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 19 15:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:56:34.984638 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:34.986766 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:35.038003 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:35.059527 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a928ce-96a1-41e4-9604-551b3f15fa01 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:35.063994 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:35.064861 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:35.065146 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:35.065423 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] PATH_INFO: `/v3/users/8a63627dc4624d9c8b73bcbfcc11fbf8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:35.066652 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a63627dc4624d9c8b73bcbfcc11fbf8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:35.068547 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:35.113279 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a63627dc4624d9c8b73bcbfcc11fbf8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.125483 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a63627dc4624d9c8b73bcbfcc11fbf8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.126320 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a63627dc4624d9c8b73bcbfcc11fbf8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.127052 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a63627dc4624d9c8b73bcbfcc11fbf8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.134833 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a63627dc4624d9c8b73bcbfcc11fbf8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.147323 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1449/2896] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:56:34 2022] DELETE /identity/v3/users/8a63627dc4624d9c8b73bcbfcc11fbf8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:56:35.331023 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:35.342916 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84589d49-5bf2-4cf3-99fc-1d9b61cdfa87 service swift] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:35.400780 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:35.401550 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:35.401837 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:35.402119 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] PATH_INFO: `/v3/projects/6a9e5f3b931d47b6bfb7938a89c2a37d` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:35.403341 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9e5f3b931d47b6bfb7938a89c2a37d)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:35.405259 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:35.454241 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'request_id': 'req-7e47689c-b049-46a6-bb15-8a04ed64c674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.461799 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'request_id': 'req-7e47689c-b049-46a6-bb15-8a04ed64c674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.468018 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'request_id': 'req-7e47689c-b049-46a6-bb15-8a04ed64c674'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.478911 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] The token cache is being invalidate because project 6a9e5f3b931d47b6bfb7938a89c2a37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:56:35.479196 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.479845 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.481364 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1448/2897] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:56:35 2022] DELETE /identity/v3/projects/6a9e5f3b931d47b6bfb7938a89c2a37d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:56:35.485306 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:35.486732 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:35.500410 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db42f9-a822-4622-ae53-badf24fa0592 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:35.558605 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:35.559479 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:35.559763 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:35.560041 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] PATH_INFO: `/v3/users/6c90499e0eb242a3832de85aac411fb6` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:35.561280 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c90499e0eb242a3832de85aac411fb6)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:35.563287 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:35.611450 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c90499e0eb242a3832de85aac411fb6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.623809 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c90499e0eb242a3832de85aac411fb6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.624475 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c90499e0eb242a3832de85aac411fb6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.625083 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c90499e0eb242a3832de85aac411fb6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.629568 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:35.633535 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c90499e0eb242a3832de85aac411fb6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.646987 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1450/2898] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:56:35 2022] DELETE /identity/v3/users/6c90499e0eb242a3832de85aac411fb6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:56:35.822391 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:56:35.823764 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:56:35.840736 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47689c-b049-46a6-bb15-8a04ed64c674 admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:56:35.871815 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:35.903222 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:56:35.903997 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:56:35.904280 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:56:35.904554 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] PATH_INFO: `/v3/projects/da347b264fed4a4f922936ec4a2af873` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:56:35.905752 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=da347b264fed4a4f922936ec4a2af873)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:56:35.907774 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:56:35.956253 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da347b264fed4a4f922936ec4a2af873', 'request_id': 'req-4801b37a-763e-4dcd-8a0a-372547814bec'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.965349 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da347b264fed4a4f922936ec4a2af873', 'request_id': 'req-4801b37a-763e-4dcd-8a0a-372547814bec'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.971904 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da347b264fed4a4f922936ec4a2af873', 'request_id': 'req-4801b37a-763e-4dcd-8a0a-372547814bec'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.983015 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] The token cache is being invalidate because project da347b264fed4a4f922936ec4a2af873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:56:35.983315 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.983968 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:56:35.985726 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1449/2899] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:56:35 2022] DELETE /identity/v3/projects/da347b264fed4a4f922936ec4a2af873 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:56:45.643489 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:45.979903 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:50.426748 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:50.428855 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:50.517989 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc42c9-5ab8-45ba-b404-d7567fb8e6f4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:50.592610 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:50.593265 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:50.593548 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:50.593850 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:50.595744 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:50.607760 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:50.609345 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:50.620292 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1451/2900] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:57:53.755158 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:53.756562 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:53.775024 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b37a-763e-4dcd-8a0a-372547814bec admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:53.782877 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:53.783542 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] REQUEST_METHOD: `GET` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:53.783829 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:53.784111 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:53.785955 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:53.798826 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:53.801284 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:53.818079 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1450/2901] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:57:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:57:53.823253 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:53.824791 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:53.892779 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acee1c-c682-4118-9f0e-e125ea260b0e service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:53.897232 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:53.898087 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:53.898382 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:53.898673 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] PATH_INFO: `/v3/users/674d054767ff4eec993ca7fefdce3967` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:53.899949 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=674d054767ff4eec993ca7fefdce3967)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:53.901846 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:53.939577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:53.949351 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674d054767ff4eec993ca7fefdce3967'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:53.961168 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674d054767ff4eec993ca7fefdce3967'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:53.961863 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674d054767ff4eec993ca7fefdce3967'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:53.962528 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674d054767ff4eec993ca7fefdce3967'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:53.969414 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674d054767ff4eec993ca7fefdce3967'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:53.984803 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1452/2902] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:57:53 2022] DELETE /identity/v3/users/674d054767ff4eec993ca7fefdce3967 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:57:54.161647 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:54.173444 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674ddc7-1685-4f73-baa4-fd6f3e313f4a service placement] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:54.239468 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:54.240379 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:54.240668 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:54.240951 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] PATH_INFO: `/v3/projects/cf521f7d98c641d4941eb041acf65405` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:54.242142 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf521f7d98c641d4941eb041acf65405)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:54.244180 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:54.290700 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf521f7d98c641d4941eb041acf65405', 'request_id': 'req-e873f349-3582-4ddb-81c6-dac87ddb3c0a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.298635 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf521f7d98c641d4941eb041acf65405', 'request_id': 'req-e873f349-3582-4ddb-81c6-dac87ddb3c0a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.305181 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf521f7d98c641d4941eb041acf65405', 'request_id': 'req-e873f349-3582-4ddb-81c6-dac87ddb3c0a'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.316384 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] The token cache is being invalidate because project cf521f7d98c641d4941eb041acf65405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:57:54.316673 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.317302 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.318871 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1451/2903] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:57:54 2022] DELETE /identity/v3/projects/cf521f7d98c641d4941eb041acf65405 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:57:54.323105 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:54.324621 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:54.338204 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d777a-bf37-4f60-9f1a-042b9bc8ff3e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:54.395235 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:54.396679 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:54.397129 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:54.397420 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] PATH_INFO: `/v3/users/b4538bd7fd344bf5917783f16f5a4165` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:54.398685 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4538bd7fd344bf5917783f16f5a4165)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:54.401776 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:54.450976 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4538bd7fd344bf5917783f16f5a4165'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.463273 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4538bd7fd344bf5917783f16f5a4165'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.463960 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4538bd7fd344bf5917783f16f5a4165'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.464577 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4538bd7fd344bf5917783f16f5a4165'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.471393 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4538bd7fd344bf5917783f16f5a4165'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.484330 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1453/2904] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 19 15:57:54 2022] DELETE /identity/v3/users/b4538bd7fd344bf5917783f16f5a4165 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:57:54.658694 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Authenticating user token {{(pid=86832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:54.660174 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.fernet_utils [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:54.675739 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873f349-3582-4ddb-81c6-dac87ddb3c0a admin admin] Validating token access rules against request {{(pid=86832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:54.739713 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc78df0f6ac445d5b0a04a3f9969c79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a28683ac9174fb4a8e11a5ac75df07c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:54.740575 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:54.740856 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:54.741131 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] PATH_INFO: `/v3/projects/6fbfbb0c816a4176bd9b0c634c1cae77` {{(pid=86832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:54.742347 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbfbb0c816a4176bd9b0c634c1cae77)` {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:54.744482 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] RBAC: Authorization granted {{(pid=86832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:54.769894 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:54.797511 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbfbb0c816a4176bd9b0c634c1cae77', 'request_id': 'req-1cd2a366-d07d-4e7c-b747-86dada935d16'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.804747 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbfbb0c816a4176bd9b0c634c1cae77', 'request_id': 'req-1cd2a366-d07d-4e7c-b747-86dada935d16'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.811165 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbfbb0c816a4176bd9b0c634c1cae77', 'request_id': 'req-1cd2a366-d07d-4e7c-b747-86dada935d16'} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.821246 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] The token cache is being invalidate because project 6fbfbb0c816a4176bd9b0c634c1cae77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:57:54.821532 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.822790 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG keystone.notifications [None req-1cd2a366-d07d-4e7c-b747-86dada935d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:57:54.824447 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: [pid: 86832|app: 0|req: 1452/2905] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 19 15:57:54 2022] DELETE /identity/v3/projects/6fbfbb0c816a4176bd9b0c634c1cae77 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:58:04.480836 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=69,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:04.818340 dv-cinder-849022-3-iscsi devstack@keystone.service[86832]: DEBUG dbcounter [-] [86832] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:59:17.673325 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:59:17.674804 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:59:17.744286 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933540-829c-4114-927b-25b32aaccc2f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:59:17.802770 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a1ee469cae4cf8a166bc259d3e17c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddde0c699c9f4c57a812bfb3b2bfa3a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:59:17.803422 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:59:17.803711 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:59:17.803995 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:59:17.805811 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:59:17.817968 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:59:17.819592 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb265b-05ff-4146-9655-00c32a3f4890 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:59:17.830227 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1454/2906] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 19 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:59:27.825933 dv-cinder-849022-3-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=58 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}